Nov 05 04:09:24 devstack cinder-volume[76137]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 04:09:24 devstack cinder-volume[76137]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 04:09:24 devstack cinder-volume[76137]: we strongly recommend against using it for new projects.
Nov 05 04:09:24 devstack cinder-volume[76137]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 04:09:24 devstack cinder-volume[76137]: framework.  For more detail see
Nov 05 04:09:24 devstack cinder-volume[76137]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 04:09:24 devstack cinder-volume[76137]:   import eventlet  # noqa
Nov 05 04:09:27 devstack cinder-volume[76137]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 04:09:27 devstack cinder-volume[76137]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 04:09:27 devstack cinder-volume[76137]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 04:09:28 devstack cinder-volume[76137]: INFO dbcounter [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Registered counter for database cinder
Nov 05 04:09:28 devstack cinder-volume[76137]: DEBUG oslo_db.sqlalchemy.engines [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:09:28 devstack cinder-volume[76137]: DEBUG dbcounter [-] [76137] Writer thread running {{(pid=76137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 04:09:28 devstack cinder-volume[76137]: INFO cinder.rpc [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 04:09:28 devstack cinder-volume[76137]: INFO cinder.rpc [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 04:09:28 devstack cinder-volume[76137]: DEBUG oslo_db.sqlalchemy.engines [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:09:28 devstack cinder-volume[76137]: INFO cinder.volume.manager [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Determined volume DB was empty at startup.
Nov 05 04:09:28 devstack cinder-volume[76137]: DEBUG cinder.volume.manager [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76137) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 04:09:28 devstack cinder-volume[76137]: INFO cinder.volume.manager [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 04:09:28 devstack cinder-volume[76137]: WARNING stevedore.named [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 04:09:28 devstack cinder-volume[76137]: WARNING castellan.key_manager [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 04:09:28 devstack cinder-volume[76137]: WARNING cinder.keymgr.conf_key_mgr [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 04:09:28 devstack cinder-volume[76137]: DEBUG cinder.volume.drivers.lvm [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76137) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 05 04:09:28 devstack cinder-volume[76137]: DEBUG oslo_concurrency.processutils [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_concurrency.processutils [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] CMD "cinder-rtstool verify" returned: 0 in 0.421s {{(pid=76137) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_db.sqlalchemy.engines [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:09:29 devstack cinder-volume[76137]: INFO cinder.rpc [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 05 04:09:29 devstack cinder-volume[76137]: INFO cinder.rpc [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 05 04:09:29 devstack cinder-volume[76137]: WARNING stevedore.named [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 04:09:29 devstack cinder-volume[76137]: WARNING castellan.key_manager [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 04:09:29 devstack cinder-volume[76137]: INFO cinder.volume.manager [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_db.sqlalchemy.engines [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76137) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:09:29 devstack cinder-volume[76137]: INFO oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Starting 1 workers
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Started child 76283 {{(pid=76137) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Full set of CONF: {{(pid=76137) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] ******************************************************************************** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Configuration options gathered from: {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] ================================================================================ {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] allow_availability_zone_fallback = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] allow_compression_on_image_upload = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] allowed_direct_url_schemes     = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76283]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] api_rate_limit                 = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] auth_strategy                  = keystone {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] az_cache_duration              = 3600 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_availability_zone      = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_host                   = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_name                   = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_stats_polling_interval = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backup_api_class               = cinder.backup.api.API {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backup_name_template           = backup-%s {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backup_use_same_host           = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backup_use_temp_snapshot       = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] chap_password                  = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] chap_username                  =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cinder_internal_tenant_project_id = 2d6ad5c5253a4c459c0bfa731e34fe57 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cinder_internal_tenant_user_id = 9e40d06847c448599419a5079a45d256 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cloned_volume_same_az          = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cluster                        = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] compression_format             = gzip {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] compute_api_class              = cinder.compute.nova.API {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] config_dir                     = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] config_source                  = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] control_exchange               = openstack {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] debug                          = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] default_availability_zone      = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] default_group_type             = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] default_volume_type            = lvmdriver-1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] disk_geometry                  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] driver_client_cert             = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] driver_client_cert_key         = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] driver_data_namespace          = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] driver_ssl_cert_path           = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] driver_ssl_cert_verify         = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] driver_use_ssl                 = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] enable_force_upload            = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] enable_new_services            = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] enable_unsupported_driver      = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] enforce_multipath_for_image_xfer = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] filter_function                = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_api_insecure            = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_api_servers             = ['http://192.168.122.32/image'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_api_ssl_compression     = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_ca_certificates_file    = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_catalog_info            = image:glance:publicURL {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_certfile                = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_keyfile                 = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_num_retries             = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance_request_timeout         = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] goodness_function              = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] graceful_shutdown_timeout      = 5 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] group_api_class                = cinder.group.api.API {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] host                           = devstack {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_compress_on_upload       = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76283]: INFO cinder.volume.manager [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 05 04:09:29 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_conversion_address_space_limit = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_conversion_cpu_limit     = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_conversion_disable       = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_introspection_address_space_limit = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_introspection_cpu_limit  = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_upload_use_cinder_backend = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_upload_use_internal_tenant = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_volume_cache_enabled     = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_volume_cache_max_count   = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] image_volume_cache_max_size_gb = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] init_host_max_objects_retrieval = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] instance_format                = [instance: %(uuid)s]  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] iscsi_target_flags             =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] iscsi_write_cache              = on {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] iser_helper                    = tgtadm {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] iser_ip_address                = 192.168.122.32 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] iser_port                      = 3260 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] log_color                      = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] log_config_append              = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] log_dir                        = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] log_file                       = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] log_options                    = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] log_rotate_interval            = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] log_rotate_interval_type       = days {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] log_rotation_type              = none {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] max_age                        = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] max_logfile_count              = 30 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] max_logfile_size_mb            = 200 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] max_over_subscription_ratio    = 20.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] message_reap_interval          = 86400 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] message_ttl                    = 2592000 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] migration_create_volume_timeout_secs = 300 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] monkey_patch                   = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] monkey_patch_modules           = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] my_ip                          = 192.168.122.32 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] no_snapshot_gb_quota           = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] num_iser_scan_tries            = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] num_shell_tries                = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] num_volume_device_scan_tries   = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] nvmeof_conn_info_version       = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] nvmet_ns_id                    = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] nvmet_port_id                  = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] osapi_max_limit                = 1000 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] osapi_volume_ext_list          = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] osapi_volume_listen_port       = 8776 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] osapi_volume_use_ssl           = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] osapi_volume_workers           = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] per_volume_size_limit          = -1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] periodic_fuzzy_delay           = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] periodic_interval              = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] public_endpoint                = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] publish_errors                 = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] quota_backup_gigabytes         = 1000 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] quota_backups                  = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] quota_gigabytes                = 1000 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] quota_groups                   = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] quota_snapshots                = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] quota_volumes                  = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] rate_limit_burst               = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] rate_limit_except_level        = CRITICAL {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] rate_limit_interval            = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] reinit_driver_count            = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] replication_device             = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] report_discard_supported       = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] report_interval                = 120 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] reservation_clean_interval     = 86400 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] reservation_expire             = 86400 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] reserved_image_namespaces      = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] reserved_percentage            = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] rpc_response_timeout           = 120 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] run_external_periodic_tasks    = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] scst_target_driver             = iscsi {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] scst_target_iqn_name           = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_down_time              = 720 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] shell_completion               = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] snapshot_name_template         = snapshot-%s {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] snapshot_same_host             = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] split_loggers                  = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] state_path                     = /opt/stack/data/cinder {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] storage_availability_zone      = nova {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:29 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] storage_protocol               = iSCSI {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] syslog_log_facility            = LOG_USER {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] target_helper                  = lioadm {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] target_ip_address              = 192.168.122.32 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] target_port                    = 3260 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] target_protocol                = iscsi {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] target_secondary_ip_addresses  = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] trace_flags                    = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] transport_url                  = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] until_refresh                  = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] use_chap_auth                  = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] use_default_quota_class        = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] use_journal                    = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] use_json                       = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] use_multipath_for_image_xfer   = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] use_stderr                     = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] use_syslog                     = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] verify_glance_signatures       = enabled {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_api_class               = cinder.volume.api.API {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_backend_name            = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_clear                   = zero {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_clear_ionice            = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_clear_size              = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_copy_bps_limit          = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_dd_blocksize            = 1M {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_name_template           = volume-%s {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_service_inithost_offload = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volume_usage_audit_period      = month {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:29 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] zoning_mode                    = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_concurrency.disable_process_locking = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.auth_section = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.auth_type   = password {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.auth_version = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.cache       = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack sudo[76288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 05 04:09:29 devstack sudo[76288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.certfile    = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.delay_auth_decision = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.http_connect_timeout = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.include_service_catalog = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.insecure    = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.interface   = public {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.keyfile     = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_password = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcache_username = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.region_name = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.service_token_roles_required = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.service_type = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.token_cache_time = 300 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.32/identity {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.backend                  = dogpile.cache.null {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.backend_argument         = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.backend_expiration_time  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.config_prefix            = cache.oslo {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.debug_cache_backend      = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.enable_retry_client      = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.enable_socket_keepalive  = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.enabled                  = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.expiration_time          = 600 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.hashclient_retry_attempts = 2 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.memcache_dead_retry      = 300 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.memcache_pool_maxsize    = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.memcache_sasl_enabled    = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.password                 = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.proxies                  = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.redis_db                 = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.redis_sentinel_service_name = mymaster {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.redis_server             = localhost:6379 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.retry_attempts           = 2 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.retry_delay              = 0.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.socket_keepalive_count   = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.socket_keepalive_idle    = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.socket_keepalive_interval = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.socket_timeout           = 1.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.tls_allowed_ciphers      = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.tls_cafile               = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.tls_certfile             = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.tls_enabled              = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.tls_keyfile              = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cache.username                 = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] coordination.backend_url       = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.asyncio_connection    = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.asyncio_slave_connection = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.backend               = sqlalchemy {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.connection            = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.connection_debug      = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.connection_parameters =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.connection_recycle_time = 3600 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.connection_trace      = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.db_inc_retry_interval = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.db_max_retries        = 20 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.db_max_retry_interval = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.db_retry_interval     = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.max_overflow          = 50 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.max_pool_size         = 5 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.max_retries           = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.mysql_wsrep_sync_wait = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.pool_timeout          = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.retry_interval        = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.slave_connection      = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.sqlite_synchronous    = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.synchronous_reader    = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] database.use_db_reconnect      = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_tracing.insecure = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.connection_string     = messaging:// {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.enabled               = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.es_doc_type           = notification {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.es_scroll_size        = 10000 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.es_scroll_time        = 2m {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.filter_error_trace    = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.hmac_keys             = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.sentinel_service_name = mymaster {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.socket_timeout        = 0.1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.trace_requests        = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler.trace_sqlalchemy      = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler_jaeger.process_tags   = {} {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler_jaeger.service_name_prefix = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] profiler_otlp.service_name_prefix = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.enforce_new_defaults = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.policy_default_rule = default {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.policy_file        = policy.yaml {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] privsep_osbrick.group          = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] privsep_osbrick.helper_command = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] privsep_osbrick.user           = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cinder_sys_admin.group         = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cinder_sys_admin.helper_command = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] cinder_sys_admin.user          = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.auth_section      = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.auth_type         = password {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.cafile            = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.certfile          = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.collect_timing    = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.insecure          = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.keyfile           = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.send_service_user_token = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.split_loggers     = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.timeout           = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.tls_ciphers       = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] service_user.tls_min_version   = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.auth_section            = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.auth_type               = password {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.certfile                = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.collect_timing          = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.insecure                = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.keyfile                 = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.region_name             = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.split_loggers           = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.timeout                 = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.tls_ciphers             = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] glance.tls_min_version         = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.backend_availability_zone = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.chap_password = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.chap_username =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.disk_geometry = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.driver_client_cert = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.driver_client_cert_key = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.driver_data_namespace = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.driver_use_ssl = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.enable_unsupported_driver = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.extra_capabilities = {} {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.filter_function = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.goodness_function = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.iscsi_target_flags =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.iscsi_write_cache = on {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.iser_helper   = tgtadm {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.iser_port     = 3260 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.lvm_share_target = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.lvm_type      = auto {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.num_shell_tries = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.nvmet_port_id = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.replication_device = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.report_discard_supported = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.reserved_percentage = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.scst_target_driver = iscsi {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.scst_target_iqn_name = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.storage_protocol = iSCSI {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.target_helper = tgtadm {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.target_port   = 3260 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.target_protocol = iscsi {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.trace_flags   = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.unique_fqdn_network = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.use_chap_auth = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volume_backend_name = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volume_clear  = zero {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volume_clear_ionice = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volume_clear_size = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_reports.file_event_handler = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_reports.log_dir           = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.backend_availability_zone = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.backend_host       = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.chap_password      = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.chap_username      = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.disk_geometry      = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.driver_client_cert = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.driver_data_namespace = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.extra_capabilities = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.filter_function    = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.goodness_function  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.iser_helper        = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.iser_ip_address    = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.iser_port          = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.iser_target_prefix = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.lvm_share_target   = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.lvm_type           = auto {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.num_shell_tries    = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.replication_device = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.report_discard_supported = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.reserved_percentage = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.scst_target_driver = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.storage_protocol   = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.target_helper      = lioadm {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.target_ip_address  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.target_port        = 3260 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.trace_flags        = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.use_chap_auth      = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volume_clear       = zero {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volume_clear_size  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack sudo[76288]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.358s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] lvmdriver-1.volumes_dir        = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.ssl      = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_notifications.driver = [] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_notifications.retry = -1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] oslo_messaging_notifications.transport_url = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] key_manager.fixed_key          = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.barbican_api_version  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.barbican_endpoint     = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.barbican_endpoint_type = public {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.barbican_region_name  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.cafile                = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.certfile              = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.collect_timing        = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:29 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.insecure              = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.keyfile               = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.number_of_retries     = 60 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.retry_delay           = 1 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.send_service_user_token = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.split_loggers         = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.timeout               = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.tls_ciphers           = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.tls_min_version       = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.verify_ssl            = True {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican.verify_ssl_path       = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.auth_section = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.auth_type = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.cafile   = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.certfile = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.collect_timing = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.insecure = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.keyfile  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.split_loggers = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.timeout  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.tls_ciphers = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] barbican_service_user.tls_min_version = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.approle_role_id          = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.approle_secret_id        = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.auth_method              = approle {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.auth_path                = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.kv_mountpoint            = secret {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.kv_path                  = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.kv_version               = 2 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.namespace                = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.root_token_id            = **** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.ssl_ca_crt_file          = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.timeout                  = 60.0 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.token_file               = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.token_role               = None {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.use_ssl                  = False {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:09:30 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] ******************************************************************************** {{(pid=76137) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 04:09:30 devstack sudo[76292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:09:30 devstack sudo[76292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:30 devstack sudo[76292]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:30 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.356s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:30 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:09:30 devstack cinder-volume[76283]: INFO cinder.brick.local_dev.lvm [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 05 04:09:30 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:30 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:30 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:30 devstack sudo[76304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 04:09:30 devstack sudo[76304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:30 devstack sudo[76304]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:30 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:30 devstack cinder-volume[76283]: DEBUG cinder.brick.local_dev.lvm [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76283) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 05 04:09:30 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:30 devstack sudo[76414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:09:30 devstack sudo[76414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:31 devstack sudo[76414]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.531s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:31 devstack sudo[76619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:09:31 devstack sudo[76619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:31 devstack sudo[76619]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:31 devstack sudo[76708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 05 04:09:31 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:31 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.262s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:31 devstack sudo[76792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 04:09:31 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:31 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:31 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:32 devstack sudo[76899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 04:09:32 devstack sudo[76899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:32 devstack sudo[76899]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:32 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:32 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:32 devstack sudo[76911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:09:32 devstack sudo[76911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:32 devstack sudo[76911]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:32 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:32 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:32 devstack sudo[76987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:09:32 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:32 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:32 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:32 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:32 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:32 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:32 devstack sudo[77000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:09:32 devstack sudo[77000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:33 devstack sudo[77000]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:33 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.313s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:33 devstack cinder-volume[76283]: INFO cinder.volume.drivers.lvm [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 05 04:09:33 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:33 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:33 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:33 devstack sudo[77033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:09:33 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:33 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:33 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:33 devstack cinder-volume[76283]: DEBUG cinder.volume.drivers.lvm [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Updating volume stats {{(pid=76283) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 04:09:33 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:33 devstack sudo[77099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 04:09:33 devstack sudo[77099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:33 devstack sudo[77099]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:33 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:33 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:33 devstack sudo[77102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:09:33 devstack sudo[77102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:34 devstack sudo[77102]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:34 devstack sudo[77105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:09:34 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:34 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:34 devstack sudo[77108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:09:34 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:34 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:34 devstack cinder-volume[76283]: INFO cinder.volume.driver [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG cinder.volume.driver [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76283) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG oslo_db.sqlalchemy.engines [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76283) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG dbcounter [-] [76283] Writer thread running {{(pid=76283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG cinder.db.api [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Building query based on filter {{(pid=76283) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG cinder.image.image_utils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76283) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 04:09:34 devstack cinder-volume[76283]: INFO cinder.keymgr.migration [None req-96a8bbb2-551c-4ea7-a189-187267d57530 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG cinder.volume.drivers.lvm [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Updating volume stats {{(pid=76283) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:34 devstack sudo[77112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 04:09:34 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:34 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:34 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:34 devstack sudo[77115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:09:34 devstack sudo[77115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:35 devstack sudo[77115]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:35 devstack sudo[77118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:09:35 devstack sudo[77118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:35 devstack sudo[77118]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:35 devstack sudo[77123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:09:35 devstack sudo[77123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:35 devstack sudo[77123]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG cinder.manager [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Notifying Schedulers of capabilities ... {{(pid=76283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:09:35 devstack cinder-volume[76283]: INFO cinder.volume.manager [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Driver initialization completed successfully.
Nov 05 04:09:35 devstack cinder-volume[76283]: INFO cinder.manager [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Initiating service 2 cleanup
Nov 05 04:09:35 devstack cinder-volume[76283]: INFO cinder.manager [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Service 2 cleanup completed.
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG cinder.service [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Creating RPC server for service cinder-volume {{(pid=76283) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG cinder.service [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76283) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 04:09:35 devstack cinder-volume[76283]: INFO cinder.volume.manager [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG cinder.volume.drivers.lvm [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Updating volume stats {{(pid=76283) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 04:09:35 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:35 devstack sudo[77127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 04:09:35 devstack sudo[77127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:36 devstack sudo[77127]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:36 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:36 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:36 devstack sudo[77130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:09:36 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:36 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:36 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:36 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:36 devstack sudo[77133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:09:36 devstack sudo[77133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:36 devstack sudo[77133]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:36 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:36 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:09:36 devstack sudo[77139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:09:36 devstack sudo[77139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:09:36 devstack sudo[77139]: pam_unix(sudo:session): session closed for user root
Nov 05 04:09:36 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:09:36 devstack cinder-volume[76283]: INFO cinder.volume.manager [None req-be293d8b-fd13-43fa-9efb-13b304eb846c None None] Driver post RPC initialization completed successfully.
Nov 05 04:09:39 devstack cinder-volume[76137]: DEBUG dbcounter [-] [76137] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76137) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:09:45 devstack cinder-volume[76283]: DEBUG dbcounter [-] [76283] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:09:46 devstack cinder-volume[76283]: DEBUG dbcounter [-] [76283] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:10:16 devstack cinder-volume[76283]: DEBUG oslo_service.periodic_task [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running periodic task VolumeManager._thread_info {{(pid=76283) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:10:16 devstack cinder-volume[76283]: DEBUG cinder.volume.manager [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] thread count: 6 {{(pid=76283) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:10:16 devstack cinder-volume[76283]: DEBUG cinder.volume.manager [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] thread info: [<_MainThread(MainThread, started 128838178926720)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128838068661056)>, <Thread(Thread-3 (stat_writer), started daemon 128838063764544)>, <Thread(Rabbit-heartbeat, started daemon 128838064408832)>, <Thread(Thread-5 (_runner), started daemon 128838063398208)>, <Thread(Thread-7 (_runner), started daemon 128838063546624)>] {{(pid=76283) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:11:16 devstack cinder-volume[76283]: DEBUG oslo_service.periodic_task [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76283) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:11:16 devstack cinder-volume[76283]: DEBUG cinder.volume.drivers.lvm [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Updating volume stats {{(pid=76283) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 04:11:16 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:11:17 devstack sudo[82220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 04:11:17 devstack sudo[82220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:11:17 devstack sudo[82220]: pam_unix(sudo:session): session closed for user root
Nov 05 04:11:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:11:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:11:17 devstack sudo[82257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:11:17 devstack sudo[82257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:11:17 devstack sudo[82257]: pam_unix(sudo:session): session closed for user root
Nov 05 04:11:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:11:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:11:17 devstack sudo[82262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:11:17 devstack sudo[82262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:11:17 devstack sudo[82262]: pam_unix(sudo:session): session closed for user root
Nov 05 04:11:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:11:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:11:17 devstack sudo[82265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:11:17 devstack sudo[82265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:11:18 devstack sudo[82265]: pam_unix(sudo:session): session closed for user root
Nov 05 04:11:18 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:11:18 devstack cinder-volume[76283]: DEBUG cinder.manager [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Notifying Schedulers of capabilities ... {{(pid=76283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:11:18 devstack cinder-volume[76283]: DEBUG oslo_service.periodic_task [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running periodic task VolumeManager._thread_info {{(pid=76283) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:11:18 devstack cinder-volume[76283]: DEBUG cinder.volume.manager [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] thread count: 6 {{(pid=76283) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:11:18 devstack cinder-volume[76283]: DEBUG cinder.volume.manager [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] thread info: [<_MainThread(MainThread, started 128838178926720)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128838068661056)>, <Thread(Thread-3 (stat_writer), started daemon 128838063764544)>, <Thread(Rabbit-heartbeat, started daemon 128838064408832)>, <Thread(Thread-5 (_runner), started daemon 128838063398208)>, <Thread(Thread-7 (_runner), started daemon 128838063546624)>] {{(pid=76283) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:11:47 devstack cinder-volume[76283]: DEBUG dbcounter [-] [76283] Writing DB stats cinder:SELECT=1 {{(pid=76283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:11:47 devstack cinder-volume[76283]: DEBUG dbcounter [-] [76283] Writing DB stats cinder:UPDATE=1 {{(pid=76283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:12:16 devstack cinder-volume[76283]: DEBUG oslo_service.periodic_task [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76283) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:12:16 devstack cinder-volume[76283]: DEBUG cinder.volume.drivers.lvm [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Updating volume stats {{(pid=76283) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 04:12:16 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:12:17 devstack sudo[84035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 04:12:17 devstack sudo[84035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:12:17 devstack sudo[84035]: pam_unix(sudo:session): session closed for user root
Nov 05 04:12:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:12:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:12:17 devstack sudo[84038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:12:17 devstack sudo[84038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:12:17 devstack sudo[84038]: pam_unix(sudo:session): session closed for user root
Nov 05 04:12:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:12:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:12:17 devstack sudo[84095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:12:17 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:12:17 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root
Nov 05 04:12:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.318s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:12:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:12:17 devstack sudo[84101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:12:17 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:12:18 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root
Nov 05 04:12:18 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:12:18 devstack cinder-volume[76283]: DEBUG cinder.manager [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Notifying Schedulers of capabilities ... {{(pid=76283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:12:18 devstack cinder-volume[76283]: DEBUG oslo_service.periodic_task [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running periodic task VolumeManager._thread_info {{(pid=76283) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:12:18 devstack cinder-volume[76283]: DEBUG cinder.volume.manager [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] thread count: 6 {{(pid=76283) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:12:18 devstack cinder-volume[76283]: DEBUG cinder.volume.manager [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] thread info: [<_MainThread(MainThread, started 128838178926720)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 128838068661056)>, <Thread(Thread-3 (stat_writer), started daemon 128838063764544)>, <Thread(Rabbit-heartbeat, started daemon 128838064408832)>, <Thread(Thread-5 (_runner), started daemon 128838063398208)>, <Thread(Thread-7 (_runner), started daemon 128838063546624)>] {{(pid=76283) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:13:16 devstack cinder-volume[76283]: DEBUG oslo_service.periodic_task [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76283) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:13:16 devstack cinder-volume[76283]: DEBUG cinder.volume.drivers.lvm [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Updating volume stats {{(pid=76283) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 05 04:13:16 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:13:17 devstack sudo[85487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 05 04:13:17 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:13:17 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root
Nov 05 04:13:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:13:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:13:17 devstack sudo[85490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:13:17 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:13:17 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root
Nov 05 04:13:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:13:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:13:17 devstack sudo[85504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 05 04:13:17 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:13:17 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root
Nov 05 04:13:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:13:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:13:17 devstack sudo[85507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 05 04:13:17 devstack sudo[85507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:13:17 devstack sudo[85507]: pam_unix(sudo:session): session closed for user root
Nov 05 04:13:17 devstack cinder-volume[76283]: DEBUG oslo_concurrency.processutils [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76283) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:13:17 devstack cinder-volume[76283]: DEBUG cinder.manager [None req-43c90c5b-0a30-4a12-ae7c-f0bafc19b359 None None] Notifying Schedulers of capabilities ... {{(pid=76283) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:13:46 devstack cinder-volume[76283]: DEBUG dbcounter [-] [76283] Writing DB stats cinder:SELECT=1 {{(pid=76283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:13:47 devstack cinder-volume[76283]: DEBUG dbcounter [-] [76283] Writing DB stats cinder:UPDATE=1 {{(pid=76283) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:13:55 devstack cinder-volume[76137]: INFO oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Caught SIGTERM, stopping children
Nov 05 04:13:55 devstack cinder-volume[76137]: DEBUG oslo_concurrency.lockutils [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Acquiring lock "singleton_lock" {{(pid=76137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 04:13:55 devstack cinder-volume[76137]: DEBUG oslo_concurrency.lockutils [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Acquired lock "singleton_lock" {{(pid=76137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 04:13:55 devstack cinder-volume[76137]: DEBUG oslo_concurrency.lockutils [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Releasing lock "singleton_lock" {{(pid=76137) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 04:13:55 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Stop services. {{(pid=76137) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 04:13:55 devstack cinder-volume[76137]: DEBUG oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Killing children. {{(pid=76137) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 04:13:55 devstack cinder-volume[76137]: INFO oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Waiting on 1 children to exit
Nov 05 04:13:55 devstack cinder-volume[76283]: DEBUG oslo_concurrency.lockutils [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Acquiring lock "singleton_lock" {{(pid=76283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 04:13:55 devstack cinder-volume[76283]: DEBUG oslo_concurrency.lockutils [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Acquired lock "singleton_lock" {{(pid=76283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 04:13:55 devstack cinder-volume[76283]: DEBUG oslo_concurrency.lockutils [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Releasing lock "singleton_lock" {{(pid=76283) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 04:13:55 devstack cinder-volume[76283]: WARNING amqp [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 04:13:55 devstack cinder-volume[76283]: WARNING amqp [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 04:13:55 devstack cinder-volume[76137]: INFO oslo_service.backend._eventlet.service [None req-ce584bea-92c3-4df5-81ce-0d77be4e84fd None None] Child 76283 exited with status 0
Nov 05 04:13:56 devstack cinder-volume[86327]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 04:13:56 devstack cinder-volume[86327]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 04:13:56 devstack cinder-volume[86327]: we strongly recommend against using it for new projects.
Nov 05 04:13:56 devstack cinder-volume[86327]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 04:13:56 devstack cinder-volume[86327]: framework.  For more detail see
Nov 05 04:13:56 devstack cinder-volume[86327]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 04:13:56 devstack cinder-volume[86327]:   import eventlet  # noqa
Nov 05 04:13:58 devstack cinder-volume[86327]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 04:13:58 devstack cinder-volume[86327]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 04:13:58 devstack cinder-volume[86327]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 04:13:59 devstack cinder-volume[86327]: INFO dbcounter [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Registered counter for database cinder
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_db.sqlalchemy.engines [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG dbcounter [-] [86327] Writer thread running {{(pid=86327) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 04:13:59 devstack cinder-volume[86327]: INFO cinder.rpc [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 04:13:59 devstack cinder-volume[86327]: INFO cinder.rpc [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_db.sqlalchemy.engines [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:13:59 devstack cinder-volume[86327]: INFO cinder.volume.manager [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Determined volume DB was empty at startup.
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG cinder.volume.manager [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86327) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 04:13:59 devstack cinder-volume[86327]: INFO cinder.volume.manager [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 05 04:13:59 devstack cinder-volume[86327]: WARNING stevedore.named [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 04:13:59 devstack cinder-volume[86327]: WARNING castellan.key_manager [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 04:13:59 devstack cinder-volume[86327]: WARNING cinder.keymgr.conf_key_mgr [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 04:13:59 devstack cinder-volume[86327]: INFO cinder.volume.manager [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_db.sqlalchemy.engines [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86327) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:13:59 devstack cinder-volume[86327]: INFO oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Starting 1 workers
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Started child 86546 {{(pid=86327) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Full set of CONF: {{(pid=86327) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] ******************************************************************************** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Configuration options gathered from: {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] ================================================================================ {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] allow_availability_zone_fallback = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] allow_compression_on_image_upload = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] allowed_direct_url_schemes     = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] api_rate_limit                 = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] auth_strategy                  = keystone {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_availability_zone      = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_host                   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_name                   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_stats_polling_interval = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backup_api_class               = cinder.backup.api.API {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backup_name_template           = backup-%s {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backup_use_same_host           = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backup_use_temp_snapshot       = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] chap_password                  = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] chap_username                  =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cinder_internal_tenant_project_id = 2d6ad5c5253a4c459c0bfa731e34fe57 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cinder_internal_tenant_user_id = 9e40d06847c448599419a5079a45d256 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cluster                        = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] compression_format             = gzip {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] config_dir                     = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] config_source                  = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] control_exchange               = openstack {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] debug                          = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] default_availability_zone      = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] default_group_type             = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] default_volume_type            = QuobyteHD {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] disk_geometry                  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] driver_client_cert             = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] driver_client_cert_key         = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] driver_data_namespace          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] driver_ssl_cert_path           = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] driver_ssl_cert_verify         = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] driver_use_ssl                 = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] enable_new_services            = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86546]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] enable_unsupported_driver      = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] enforce_multipath_for_image_xfer = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] filter_function                = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_api_insecure            = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_api_servers             = ['http://192.168.122.32/image'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_api_ssl_compression     = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_ca_certificates_file    = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_certfile                = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_keyfile                 = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_num_retries             = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance_request_timeout         = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] goodness_function              = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] graceful_shutdown_timeout      = 5 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] group_api_class                = cinder.group.api.API {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] host                           = devstack {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_compress_on_upload       = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_conversion_address_space_limit = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_conversion_cpu_limit     = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_conversion_disable       = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_introspection_address_space_limit = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_introspection_cpu_limit  = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_upload_use_cinder_backend = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_upload_use_internal_tenant = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_volume_cache_enabled     = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_volume_cache_max_count   = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] init_host_max_objects_retrieval = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] iscsi_target_flags             =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] iscsi_write_cache              = on {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] iser_helper                    = tgtadm {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] iser_ip_address                = 192.168.122.32 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] iser_port                      = 3260 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] log_color                      = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] log_config_append              = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] log_dir                        = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] log_file                       = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] log_options                    = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] log_rotate_interval            = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] log_rotate_interval_type       = days {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] log_rotation_type              = none {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] max_age                        = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] max_logfile_count              = 30 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] max_logfile_size_mb            = 200 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] max_over_subscription_ratio    = 20.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] message_reap_interval          = 86400 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] message_ttl                    = 2592000 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] monkey_patch                   = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] monkey_patch_modules           = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] my_ip                          = 192.168.122.32 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] no_snapshot_gb_quota           = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] num_iser_scan_tries            = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] num_shell_tries                = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] num_volume_device_scan_tries   = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] nvmeof_conn_info_version       = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] nvmet_ns_id                    = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] nvmet_port_id                  = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] osapi_max_limit                = 1000 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] osapi_volume_ext_list          = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] osapi_volume_listen_port       = 8776 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] osapi_volume_use_ssl           = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] osapi_volume_workers           = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] per_volume_size_limit          = -1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] periodic_fuzzy_delay           = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] periodic_interval              = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] public_endpoint                = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] publish_errors                 = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] quota_backup_gigabytes         = 1000 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] quota_backups                  = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] quota_gigabytes                = 1000 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] quota_groups                   = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] quota_snapshots                = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] quota_volumes                  = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] rate_limit_burst               = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] rate_limit_except_level        = CRITICAL {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] rate_limit_interval            = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] reinit_driver_count            = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] replication_device             = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] report_discard_supported       = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] report_interval                = 120 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] reservation_clean_interval     = 86400 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] reservation_expire             = 86400 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] reserved_image_namespaces      = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] reserved_percentage            = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] rpc_response_timeout           = 120 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] run_external_periodic_tasks    = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] scst_target_driver             = iscsi {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] scst_target_iqn_name           = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_down_time              = 720 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] shell_completion               = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] snapshot_name_template         = snapshot-%s {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] split_loggers                  = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] state_path                     = /opt/stack/data/cinder {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] storage_availability_zone      = nova {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] storage_protocol               = iSCSI {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] syslog_log_facility            = LOG_USER {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] target_helper                  = lioadm {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] target_ip_address              = 192.168.122.32 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] target_port                    = 3260 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:13:59 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] target_protocol                = iscsi {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] target_secondary_ip_addresses  = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] trace_flags                    = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] transport_url                  = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] until_refresh                  = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] use_chap_auth                  = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] use_default_quota_class        = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] use_journal                    = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] use_json                       = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] use_multipath_for_image_xfer   = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] use_stderr                     = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] use_syslog                     = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] verify_glance_signatures       = enabled {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_api_class               = cinder.volume.api.API {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_backend_name            = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_clear                   = zero {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_clear_ionice            = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_clear_size              = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_copy_bps_limit          = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_dd_blocksize            = 1M {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_name_template           = volume-%s {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_service_inithost_offload = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volume_usage_audit_period      = month {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] zoning_mode                    = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86546]: INFO cinder.volume.manager [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.remotefs [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86546) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.auth_section = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.auth_type   = password {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.auth_version = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.cache       = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.certfile    = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.insecure    = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.interface   = public {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.keyfile     = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_password = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcache_username = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.region_name = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.service_type = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.32/identity {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.backend                  = dogpile.cache.null {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.backend_argument         = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.backend_expiration_time  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.config_prefix            = cache.oslo {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.debug_cache_backend      = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.enable_retry_client      = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.enable_socket_keepalive  = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.enabled                  = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.expiration_time          = 600 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.memcache_dead_retry      = 300 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.memcache_sasl_enabled    = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.password                 = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.proxies                  = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.redis_db                 = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.redis_server             = localhost:6379 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.retry_attempts           = 2 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.retry_delay              = 0.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.socket_keepalive_count   = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.socket_keepalive_idle    = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.socket_keepalive_interval = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.socket_timeout           = 1.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.tls_allowed_ciphers      = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.tls_cafile               = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.tls_certfile             = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.tls_enabled              = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.tls_keyfile              = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cache.username                 = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] coordination.backend_url       = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.asyncio_connection    = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.asyncio_slave_connection = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.backend               = sqlalchemy {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.connection            = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.connection_debug      = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.connection_parameters =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.connection_recycle_time = 3600 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.connection_trace      = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.db_inc_retry_interval = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.db_max_retries        = 20 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.db_max_retry_interval = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.db_retry_interval     = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.max_overflow          = 50 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.max_pool_size         = 5 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.max_retries           = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.pool_timeout          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.retry_interval        = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.slave_connection      = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.sqlite_synchronous    = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.synchronous_reader    = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] database.use_db_reconnect      = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_tracing.insecure = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.connection_string     = messaging:// {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.enabled               = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.es_doc_type           = notification {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.es_scroll_size        = 10000 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.es_scroll_time        = 2m {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.filter_error_trace    = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.hmac_keys             = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.sentinel_service_name = mymaster {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.socket_timeout        = 0.1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.trace_requests        = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler.trace_sqlalchemy      = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler_jaeger.process_tags   = {} {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] profiler_otlp.service_name_prefix = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.policy_default_rule = default {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] privsep_osbrick.group          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] privsep_osbrick.helper_command = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] privsep_osbrick.user           = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cinder_sys_admin.group         = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cinder_sys_admin.helper_command = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] cinder_sys_admin.user          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.auth_section      = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.auth_type         = password {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.cafile            = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.certfile          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.collect_timing    = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.insecure          = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.keyfile           = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.send_service_user_token = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.split_loggers     = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.timeout           = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.tls_ciphers       = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] service_user.tls_min_version   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.auth_section            = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.auth_type               = password {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.certfile                = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.collect_timing          = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.insecure                = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.keyfile                 = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.region_name             = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.split_loggers           = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.timeout                 = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.tls_ciphers             = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] glance.tls_min_version         = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.backend_availability_zone = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.chap_password = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.chap_username =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.disk_geometry = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.driver_client_cert = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.driver_data_namespace = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.driver_use_ssl = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.extra_capabilities = {} {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.filter_function = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.goodness_function = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.iscsi_target_flags =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86546) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 04:14:00 devstack cinder-volume[86546]: WARNING cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.iser_port     = 3260 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86546]: WARNING cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_host      =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_login     = admin {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_mount_options = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_password  = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_private_key =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_share_path =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Running cmd (subprocess): mount.quobyte {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.replication_device = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.report_discard_supported = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.target_helper = tgtadm {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.target_port   = 3260 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.target_protocol = iscsi {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.trace_flags   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.use_chap_auth = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.volume_backend_name = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.volume_clear  = zero {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_reports.file_event_handler = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_reports.log_dir           = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.backend_host         = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.chap_password        = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.chap_username        = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.disk_geometry        = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.driver_client_cert   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.extra_capabilities   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.filter_function      = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.goodness_function    = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.iser_helper          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.iser_ip_address      = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.iser_port            = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_host             = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_login            = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_mount_options    = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_password         = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_private_key      = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_share_path       = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.num_shell_tries      = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.replication_device   = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.report_discard_supported = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.reserved_percentage  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.scst_target_driver   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.storage_protocol     = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.target_helper        = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.target_ip_address    = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.target_port          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.target_prefix        = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.target_protocol      = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.trace_flags          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.use_chap_auth        = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.volume_clear         = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.volume_clear_size    = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] QuobyteHD.volumes_dir          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_notifications.driver = [] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] key_manager.fixed_key          = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.barbican_api_version  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.barbican_endpoint     = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.barbican_endpoint_type = public {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.barbican_region_name  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.cafile                = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.certfile              = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.collect_timing        = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.insecure              = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.keyfile               = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.number_of_retries     = 60 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.retry_delay           = 1 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.send_service_user_token = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.split_loggers         = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.timeout               = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.tls_ciphers           = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.tls_min_version       = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.verify_ssl            = True {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican.verify_ssl_path       = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.auth_section = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.auth_type = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.cafile   = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.certfile = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.collect_timing = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.insecure = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.keyfile  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.split_loggers = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.timeout  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.tls_ciphers = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] barbican_service_user.tls_min_version = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.approle_role_id          = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.approle_secret_id        = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.auth_method              = approle {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.auth_path                = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.kv_mountpoint            = secret {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.kv_path                  = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.kv_version               = 2 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.namespace                = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.root_token_id            = **** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.ssl_ca_crt_file          = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.timeout                  = 60.0 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.token_file               = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.token_role               = None {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.use_ssl                  = False {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:00 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] ******************************************************************************** {{(pid=86327) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 04:14:00 devstack quobyte-client[86551]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 04:14:00 devstack quobyte-client[86551]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=86546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:14:00 devstack cinder-volume[86546]: INFO cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 ...
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b -c /etc/quobyte/client-cinder.cfg {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:00 devstack sudo[86552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b -c /etc/quobyte/client-cinder.cfg
Nov 05 04:14:00 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:14:00 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.436s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:00 devstack cinder-volume[86546]: INFO cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 succeeded
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=86546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.448s {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:00 devstack sudo[86654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:14:00 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:14:00 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.239s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:00 devstack cinder-volume[86546]: INFO cinder.volume.driver [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG cinder.volume.driver [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.538516998291, 'free_capacity_gb': 1773.538516998291, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86546) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_db.sqlalchemy.engines [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86546) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG dbcounter [-] [86546] Writer thread running {{(pid=86546) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG cinder.db.api [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Building query based on filter {{(pid=86546) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG cinder.image.image_utils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86546) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 04:14:00 devstack cinder-volume[86546]: INFO cinder.keymgr.migration [None req-0700bfde-f45f-4d42-89ba-a880828be864 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=86546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=86546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:14:00 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:00 devstack sudo[86657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:14:00 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:14:01 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.221s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG cinder.manager [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Notifying Schedulers of capabilities ... {{(pid=86546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:14:01 devstack cinder-volume[86546]: INFO cinder.volume.manager [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Driver initialization completed successfully.
Nov 05 04:14:01 devstack cinder-volume[86546]: INFO cinder.manager [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Initiating service 3 cleanup
Nov 05 04:14:01 devstack cinder-volume[86546]: INFO cinder.manager [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Service 3 cleanup completed.
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG cinder.service [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Creating RPC server for service cinder-volume {{(pid=86546) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG cinder.service [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86546) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 04:14:01 devstack cinder-volume[86546]: INFO cinder.volume.manager [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=86546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.quobyte [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=86546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:01 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:14:01 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:14:01 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Nov 05 04:14:01 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.260s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:01 devstack cinder-volume[86546]: INFO cinder.volume.manager [None req-f32c2dc6-fd46-4b39-9d1f-2a4224aabd9a None None] Driver post RPC initialization completed successfully.
Nov 05 04:14:06 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-58e9f874-4f62-49f4-9e74-77a8af29b76e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:14:06 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-58e9f874-4f62-49f4-9e74-77a8af29b76e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:14:06 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.quobyte [None req-58e9f874-4f62-49f4-9e74-77a8af29b76e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=86546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:14:06 devstack cinder-volume[86546]: DEBUG cinder.volume.drivers.quobyte [None req-58e9f874-4f62-49f4-9e74-77a8af29b76e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=86546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:14:06 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-58e9f874-4f62-49f4-9e74-77a8af29b76e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86546) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:14:06 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-58e9f874-4f62-49f4-9e74-77a8af29b76e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:06 devstack sudo[86811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:14:06 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:14:06 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root
Nov 05 04:14:06 devstack cinder-volume[86546]: DEBUG oslo_concurrency.processutils [None req-58e9f874-4f62-49f4-9e74-77a8af29b76e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.244s {{(pid=86546) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:06 devstack cinder-volume[86546]: DEBUG cinder.manager [None req-58e9f874-4f62-49f4-9e74-77a8af29b76e None None] Notifying Schedulers of capabilities ... {{(pid=86546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:14:06 devstack cinder-volume[86327]: INFO oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Caught SIGTERM, stopping children
Nov 05 04:14:06 devstack cinder-volume[86327]: DEBUG oslo_concurrency.lockutils [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Acquiring lock "singleton_lock" {{(pid=86327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 04:14:06 devstack cinder-volume[86327]: DEBUG oslo_concurrency.lockutils [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Acquired lock "singleton_lock" {{(pid=86327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 04:14:06 devstack cinder-volume[86327]: DEBUG oslo_concurrency.lockutils [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Releasing lock "singleton_lock" {{(pid=86327) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 04:14:06 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Stop services. {{(pid=86327) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 05 04:14:06 devstack cinder-volume[86327]: DEBUG oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Killing children. {{(pid=86327) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 05 04:14:06 devstack cinder-volume[86327]: INFO oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Waiting on 1 children to exit
Nov 05 04:14:09 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Acquiring lock "singleton_lock" {{(pid=86546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 04:14:09 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Acquired lock "singleton_lock" {{(pid=86546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 04:14:09 devstack cinder-volume[86546]: DEBUG oslo_concurrency.lockutils [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Releasing lock "singleton_lock" {{(pid=86546) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 04:14:09 devstack cinder-volume[86546]: WARNING amqp [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 04:14:09 devstack cinder-volume[86546]: WARNING amqp [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 05 04:14:09 devstack cinder-volume[86327]: INFO oslo_service.backend._eventlet.service [None req-d1c397be-d407-48bd-b1b7-68ba6923b3d3 None None] Child 86546 exited with status 0
Nov 05 04:14:10 devstack cinder-volume[86865]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 05 04:14:10 devstack cinder-volume[86865]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 04:14:10 devstack cinder-volume[86865]: we strongly recommend against using it for new projects.
Nov 05 04:14:10 devstack cinder-volume[86865]: If you are already using Eventlet, we recommend migrating to a different
Nov 05 04:14:10 devstack cinder-volume[86865]: framework.  For more detail see
Nov 05 04:14:10 devstack cinder-volume[86865]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 04:14:10 devstack cinder-volume[86865]:   import eventlet  # noqa
Nov 05 04:14:13 devstack cinder-volume[86865]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 05 04:14:13 devstack cinder-volume[86865]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 05 04:14:13 devstack cinder-volume[86865]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86865) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 05 04:14:14 devstack cinder-volume[86865]: INFO dbcounter [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Registered counter for database cinder
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG dbcounter [-] [86865] Writer thread running {{(pid=86865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 04:14:14 devstack cinder-volume[86865]: INFO cinder.rpc [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 05 04:14:14 devstack cinder-volume[86865]: INFO cinder.rpc [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:14:14 devstack cinder-volume[86865]: INFO cinder.volume.manager [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Determined volume DB was empty at startup.
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG cinder.volume.manager [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86865) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 05 04:14:14 devstack cinder-volume[86865]: WARNING stevedore.named [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 05 04:14:14 devstack cinder-volume[86865]: WARNING castellan.key_manager [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 04:14:14 devstack cinder-volume[86865]: WARNING cinder.keymgr.conf_key_mgr [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 05 04:14:14 devstack cinder-volume[86865]: INFO cinder.volume.manager [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:14:14 devstack cinder-volume[86865]: INFO oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Starting 1 workers
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Started child 87166 {{(pid=86865) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Full set of CONF: {{(pid=86865) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] ******************************************************************************** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] Configuration options gathered from: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] ================================================================================ {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] allow_availability_zone_fallback = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] allow_compression_on_image_upload = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] allowed_direct_url_schemes     = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] api_rate_limit                 = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] auth_strategy                  = keystone {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_availability_zone      = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_host                   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_name                   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_stats_polling_interval = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backup_api_class               = cinder.backup.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backup_name_template           = backup-%s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backup_use_same_host           = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[87166]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backup_use_temp_snapshot       = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] chap_password                  = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] chap_username                  =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cinder_internal_tenant_project_id = 2d6ad5c5253a4c459c0bfa731e34fe57 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cinder_internal_tenant_user_id = 9e40d06847c448599419a5079a45d256 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cluster                        = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] compression_format             = gzip {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] compute_api_class              = cinder.compute.nova.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] config_dir                     = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] config_source                  = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] control_exchange               = openstack {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] debug                          = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] default_availability_zone      = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] default_group_type             = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] default_volume_type            = QuobyteHD {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] disk_geometry                  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] driver_client_cert             = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] driver_client_cert_key         = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] driver_data_namespace          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] driver_ssl_cert_path           = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] driver_ssl_cert_verify         = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] driver_use_ssl                 = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] enable_new_services            = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] enable_unsupported_driver      = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] enabled_backends               = ['QuobyteHD'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] enforce_multipath_for_image_xfer = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] filter_function                = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_api_insecure            = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_api_servers             = ['http://192.168.122.32/image'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_api_ssl_compression     = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_ca_certificates_file    = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_catalog_info            = image:glance:publicURL {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_certfile                = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_keyfile                 = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_num_retries             = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance_request_timeout         = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] goodness_function              = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] graceful_shutdown_timeout      = 5 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] group_api_class                = cinder.group.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] host                           = devstack {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_compress_on_upload       = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_conversion_address_space_limit = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_conversion_cpu_limit     = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_conversion_disable       = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_introspection_address_space_limit = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_introspection_cpu_limit  = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_upload_use_cinder_backend = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_upload_use_internal_tenant = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_volume_cache_enabled     = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_volume_cache_max_count   = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] image_volume_cache_max_size_gb = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] init_host_max_objects_retrieval = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] instance_format                = [instance: %(uuid)s]  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] iscsi_target_flags             =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] iscsi_write_cache              = on {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] iser_helper                    = tgtadm {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] iser_ip_address                = 192.168.122.32 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] iser_port                      = 3260 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] log_color                      = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] log_config_append              = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] log_dir                        = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] log_file                       = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] log_options                    = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] log_rotate_interval            = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] log_rotate_interval_type       = days {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] log_rotation_type              = none {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] max_age                        = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] max_logfile_count              = 30 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] max_logfile_size_mb            = 200 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] max_over_subscription_ratio    = 20.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] message_reap_interval          = 86400 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] message_ttl                    = 2592000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] migration_create_volume_timeout_secs = 300 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] monkey_patch                   = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] monkey_patch_modules           = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] my_ip                          = 192.168.122.32 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] no_snapshot_gb_quota           = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] num_iser_scan_tries            = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] num_shell_tries                = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] num_volume_device_scan_tries   = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] nvmeof_conn_info_version       = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] nvmet_ns_id                    = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] nvmet_port_id                  = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] osapi_max_limit                = 1000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] osapi_volume_ext_list          = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] osapi_volume_listen_port       = 8776 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] osapi_volume_use_ssl           = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] osapi_volume_workers           = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] per_volume_size_limit          = -1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] periodic_fuzzy_delay           = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] periodic_interval              = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] public_endpoint                = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] publish_errors                 = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] quota_backup_gigabytes         = 1000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] quota_backups                  = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] quota_gigabytes                = 1000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87166) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] quota_groups                   = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] quota_snapshots                = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] quota_volumes                  = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] rate_limit_burst               = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] rate_limit_except_level        = CRITICAL {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] rate_limit_interval            = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] reinit_driver_count            = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] replication_device             = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] report_discard_supported       = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] report_interval                = 120 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] reservation_clean_interval     = 86400 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] reservation_expire             = 86400 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] reserved_image_namespaces      = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] reserved_percentage            = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] rpc_response_timeout           = 120 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] run_external_periodic_tasks    = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] scst_target_driver             = iscsi {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] scst_target_iqn_name           = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_down_time              = 720 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] shell_completion               = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] snapshot_name_template         = snapshot-%s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] split_loggers                  = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] state_path                     = /opt/stack/data/cinder {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] storage_availability_zone      = nova {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] storage_protocol               = iSCSI {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] syslog_log_facility            = LOG_USER {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] target_helper                  = lioadm {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] target_ip_address              = 192.168.122.32 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] target_port                    = 3260 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] target_protocol                = iscsi {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] target_secondary_ip_addresses  = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] trace_flags                    = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] transport_url                  = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] until_refresh                  = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] use_chap_auth                  = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] use_default_quota_class        = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] use_journal                    = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] use_json                       = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] use_multipath_for_image_xfer   = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] use_stderr                     = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] use_syslog                     = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] verify_glance_signatures       = enabled {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_api_class               = cinder.volume.api.API {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_backend_name            = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_clear                   = zero {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_clear_ionice            = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_clear_size              = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_copy_bps_limit          = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_dd_blocksize            = 1M {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_name_template           = volume-%s {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_service_inithost_offload = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volume_usage_audit_period      = month {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] zoning_mode                    = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_concurrency.disable_process_locking = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.auth_section = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.auth_type   = password {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.auth_version = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.cache       = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.certfile    = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.delay_auth_decision = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.http_connect_timeout = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.include_service_catalog = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.insecure    = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.interface   = public {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.keyfile     = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_password = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcache_username = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.region_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.service_token_roles_required = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.service_type = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.token_cache_time = 300 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.32/identity {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.backend                  = dogpile.cache.null {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.backend_argument         = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.backend_expiration_time  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.config_prefix            = cache.oslo {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.debug_cache_backend      = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.enable_retry_client      = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.enable_socket_keepalive  = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.enabled                  = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.expiration_time          = 600 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.hashclient_retry_attempts = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.memcache_dead_retry      = 300 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.memcache_pool_maxsize    = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87166) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 05 04:14:14 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.quobyte [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.quobyte [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.memcache_sasl_enabled    = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.password                 = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.proxies                  = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.redis_db                 = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Running cmd (subprocess): mount.quobyte {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.redis_sentinel_service_name = mymaster {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.redis_server             = localhost:6379 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.retry_attempts           = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.retry_delay              = 0.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.socket_keepalive_count   = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.socket_keepalive_idle    = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.socket_keepalive_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.socket_timeout           = 1.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.tls_allowed_ciphers      = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.tls_cafile               = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.tls_certfile             = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.tls_enabled              = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.tls_keyfile              = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cache.username                 = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] coordination.backend_url       = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.asyncio_connection    = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.asyncio_slave_connection = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.backend               = sqlalchemy {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.connection            = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.connection_debug      = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.connection_parameters =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.connection_recycle_time = 3600 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.connection_trace      = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.db_inc_retry_interval = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.db_max_retries        = 20 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.db_max_retry_interval = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.db_retry_interval     = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.max_overflow          = 50 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.max_pool_size         = 5 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.max_retries           = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.mysql_wsrep_sync_wait = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.pool_timeout          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.retry_interval        = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.slave_connection      = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.sqlite_synchronous    = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.synchronous_reader    = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] database.use_db_reconnect      = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_tracing.insecure = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.connection_string     = messaging:// {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.enabled               = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.es_doc_type           = notification {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.es_scroll_size        = 10000 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.es_scroll_time        = 2m {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.filter_error_trace    = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.hmac_keys             = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.sentinel_service_name = mymaster {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.socket_timeout        = 0.1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.trace_requests        = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler.trace_sqlalchemy      = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler_jaeger.process_tags   = {} {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler_jaeger.service_name_prefix = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] profiler_otlp.service_name_prefix = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.enforce_new_defaults = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.policy_default_rule = default {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.policy_file        = policy.yaml {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] privsep_osbrick.group          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] privsep_osbrick.helper_command = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] privsep_osbrick.user           = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cinder_sys_admin.group         = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cinder_sys_admin.helper_command = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] cinder_sys_admin.user          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.auth_section      = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.auth_type         = password {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.cafile            = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.certfile          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.collect_timing    = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.insecure          = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.keyfile           = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.send_service_user_token = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.split_loggers     = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.timeout           = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.tls_ciphers       = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] service_user.tls_min_version   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.auth_section            = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.auth_type               = password {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.certfile                = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.collect_timing          = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.insecure                = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.keyfile                 = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.region_name             = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.split_loggers           = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.timeout                 = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.tls_ciphers             = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] glance.tls_min_version         = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.backend_availability_zone = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.chap_password = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.chap_username =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.disk_geometry = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.driver_client_cert = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.driver_client_cert_key = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.driver_data_namespace = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.driver_use_ssl = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.enable_unsupported_driver = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.extra_capabilities = {} {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.filter_function = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.goodness_function = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.iscsi_target_flags =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.iscsi_write_cache = on {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.iser_helper   = tgtadm {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.iser_ip_address = 192.168.122.32 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.iser_port     = 3260 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_host      =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_login     = admin {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_mount_options = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_password  = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_private_key =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_share_path =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.num_shell_tries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.nvmet_port_id = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.quobyte_client_cfg = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.quobyte_volume_url = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.replication_device = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack quobyte-client[87167]: Reading configuration file: /etc/quobyte/client.cfg
Nov 05 04:14:14 devstack quobyte-client[87167]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.report_discard_supported = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.reserved_percentage = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.scst_target_driver = iscsi {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.scst_target_iqn_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.storage_protocol = iSCSI {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.target_helper = tgtadm {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.target_ip_address = 192.168.122.32 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.target_port   = 3260 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.target_protocol = iscsi {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.trace_flags   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.unique_fqdn_network = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.use_chap_auth = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.volume_backend_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.volume_clear  = zero {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.volume_clear_ionice = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.volume_clear_size = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] CMD "mount.quobyte" returned: 1 in 0.094s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_reports.file_event_handler = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_reports.log_dir           = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.backend_availability_zone = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.backend_host         = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.chap_password        = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.chap_username        = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.chiscsi_conf         = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.disk_geometry        = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.driver_client_cert   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.driver_client_cert_key = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.driver_data_namespace = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.driver_use_ssl       = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.extra_capabilities   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.filter_function      = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.goodness_function    = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.iser_helper          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.iser_ip_address      = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.iser_port            = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.iser_target_prefix   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:14 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_host             = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_login            = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_mount_options    = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_password         = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_private_key      = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_share_path       = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_ssh_port         = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.num_shell_tries      = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.nvmet_port_id        = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.replication_device   = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.report_discard_supported = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.reserved_percentage  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.scst_target_driver   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.storage_protocol     = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.target_helper        = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.target_ip_address    = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.target_port          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.target_prefix        = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.target_protocol      = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.trace_flags          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.use_chap_auth        = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.volume_clear         = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.volume_clear_size    = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] QuobyteHD.volumes_dir          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.ssl      = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_notifications.driver = [] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_notifications.retry = -1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] oslo_messaging_notifications.transport_url = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] key_manager.fixed_key          = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.barbican_api_version  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.barbican_endpoint     = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.barbican_endpoint_type = public {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.barbican_region_name  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.cafile                = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.certfile              = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.collect_timing        = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.insecure              = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.keyfile               = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.number_of_retries     = 60 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.retry_delay           = 1 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.send_service_user_token = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.split_loggers         = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.timeout               = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.tls_ciphers           = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.tls_min_version       = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.verify_ssl            = True {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican.verify_ssl_path       = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.auth_section = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack sudo[87176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.auth_type = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.cafile   = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.certfile = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.collect_timing = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.insecure = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.keyfile  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.split_loggers = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.timeout  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.tls_ciphers = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] barbican_service_user.tls_min_version = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.approle_role_id          = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.approle_secret_id        = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.auth_method              = approle {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.auth_path                = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.kv_mountpoint            = secret {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.kv_path                  = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.kv_version               = 2 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.namespace                = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.root_token_id            = **** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.ssl_ca_crt_file          = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.timeout                  = 60.0 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.token_file               = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.token_role               = None {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.use_ssl                  = False {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 05 04:14:15 devstack cinder-volume[86865]: DEBUG oslo_service.backend._eventlet.service [None req-c3c8c9d7-6182-4d69-b8a0-fa010a559aec None None] ******************************************************************************** {{(pid=86865) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 05 04:14:15 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:15 devstack cinder-volume[87166]: INFO cinder.volume.driver [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Driver hasn't implemented _init_vendor_properties()
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.volume.driver [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.538516998291, 'free_capacity_gb': 1773.538516998291, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87166) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_db.sqlalchemy.engines [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87166) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writer thread running {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.db.api [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Building query based on filter {{(pid=87166) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87166) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:15 devstack cinder-volume[87166]: INFO cinder.keymgr.migration [None req-e06d8204-e1aa-4a89-ba20-72c5ef68a5bb None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 05 04:14:15 devstack sudo[87189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:14:15 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:14:15 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.234s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:14:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Driver initialization completed successfully.
Nov 05 04:14:15 devstack cinder-volume[87166]: INFO cinder.manager [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Initiating service 3 cleanup
Nov 05 04:14:15 devstack cinder-volume[87166]: INFO cinder.manager [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Service 3 cleanup completed.
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.service [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Creating RPC server for service cinder-volume {{(pid=87166) start /opt/stack/cinder/cinder/service.py:231}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.service [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87166) start /opt/stack/cinder/cinder/service.py:237}}
Nov 05 04:14:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:14:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:14:15 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:14:15 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:14:16 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Nov 05 04:14:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:14:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d76851c6-4da9-4613-ba6f-feda2f02e02d None None] Driver post RPC initialization completed successfully.
Nov 05 04:14:24 devstack cinder-volume[86865]: DEBUG dbcounter [-] [86865] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86865) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:14:25 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:14:26 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:14:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:14:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 6 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:14:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:15:29 devstack sudo[88121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:15:29 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:15:29 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.711s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 6 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:15:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:15:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:15:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Flow 'volume_create_manager' (acb05825-375d-495f-ba29-e782070a7aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:15:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ed1ed5-2838-40eb-a927-6ae890913f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ed1ed5-2838-40eb-a927-6ae890913f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-912069389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac685218-5ba4-4a64-a040-9b048db69caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ca0af67de4431ca9399a57495e03cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:15:38Z,use_quota=True,user_id='e4ef09e5c38241b3abb363c85621f4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36f5807-24bc-4136-9614-a9fbc6d41e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36f5807-24bc-4136-9614-a9fbc6d41e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a7f23f-3d7e-4c23-bc62-a8c1ec560b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a7f23f-3d7e-4c23-bc62-a8c1ec560b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac685218-5ba4-4a64-a040-9b048db69caa', 'volume_name': 'volume-ac685218-5ba4-4a64-a040-9b048db69caa', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8ca687-1847-4eb3-b84b-8a7c01939191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8ca687-1847-4eb3-b84b-8a7c01939191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa969f8-626e-4e68-9ade-5fa73c3d8507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Volume ac685218-5ba4-4a64-a040-9b048db69caa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac685218-5ba4-4a64-a040-9b048db69caa', 'volume_size': 1}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-912069389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac685218-5ba4-4a64-a040-9b048db69caa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6ca0af67de4431ca9399a57495e03cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:15:38Z,use_quota=True,user_id='e4ef09e5c38241b3abb363c85621f4a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Creating volume ac685218-5ba4-4a64-a040-9b048db69caa {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:15:38 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:15:38 devstack sudo[88274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa 1073741824
Nov 05 04:15:38 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:15:38 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa 1073741824" returned: 0 in 0.665s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:15:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:15:38 devstack sudo[88595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa
Nov 05 04:15:38 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:15:39 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root
Nov 05 04:15:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:15:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:15:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:15:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa969f8-626e-4e68-9ade-5fa73c3d8507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac685218-5ba4-4a64-a040-9b048db69caa', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a183135-4fdd-4435-a504-570a030f921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Volume volume-ac685218-5ba4-4a64-a040-9b048db69caa (ac685218-5ba4-4a64-a040-9b048db69caa): created successfully
Nov 05 04:15:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a183135-4fdd-4435-a504-570a030f921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Flow 'volume_create_manager' (acb05825-375d-495f-ba29-e782070a7aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:15:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f4e92596-1018-417b-bee2-01b9471ac707 tempest-ServerRescueNegativeTestJSON-2081035948 None] Created volume successfully.
Nov 05 04:15:48 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:15:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Flow 'volume_create_manager' (639ac930-8a04-4b46-9d1a-458724a15a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:15:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1450547-4145-491c-b3b2-ffdab071baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1450547-4145-491c-b3b2-ffdab071baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1644569897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea646b4-1ba8-411a-b669-f4ad868e7c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ef3896401f4950ae6d0b1a2ca0b993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:15:49Z,use_quota=True,user_id='ac7dd2d0b1214c158f534a25db100695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f37a69e-c6a4-441b-857f-b263dfbcd610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f37a69e-c6a4-441b-857f-b263dfbcd610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319e5436-4fb3-449c-98a8-c8f66d863af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319e5436-4fb3-449c-98a8-c8f66d863af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ea646b4-1ba8-411a-b669-f4ad868e7c88', 'volume_name': 'volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a2d25e-22f9-4613-bf0a-9ff7879fdfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a2d25e-22f9-4613-bf0a-9ff7879fdfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d8a3c0-3450-4b9a-b3e9-5707e3ec1168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:49 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Volume 4ea646b4-1ba8-411a-b669-f4ad868e7c88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88', 'volume_size': 1}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1644569897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ea646b4-1ba8-411a-b669-f4ad868e7c88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12ef3896401f4950ae6d0b1a2ca0b993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:15:49Z,use_quota=True,user_id='ac7dd2d0b1214c158f534a25db100695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Creating volume 4ea646b4-1ba8-411a-b669-f4ad868e7c88 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:15:49 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:15:49 devstack sudo[88700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88 1073741824
Nov 05 04:15:49 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:15:49 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88 1073741824" returned: 0 in 0.716s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:15:49 devstack sudo[88711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88
Nov 05 04:15:49 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Acquiring lock "cinder-ac685218-5ba4-4a64-a040-9b048db69caa-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:15:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "cinder-ac685218-5ba4-4a64-a040-9b048db69caa-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:15:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Acquiring lock "cinder-quobyte-ac685218-5ba4-4a64-a040-9b048db69caa" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:15:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "cinder-quobyte-ac685218-5ba4-4a64-a040-9b048db69caa" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:15:50 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp85mz9z_w/privsep.sock']
Nov 05 04:15:50 devstack sudo[88713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp85mz9z_w/privsep.sock
Nov 05 04:15:50 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:15:50 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root
Nov 05 04:15:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:15:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:15:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:15:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d8a3c0-3450-4b9a-b3e9-5707e3ec1168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5dc93d-fd98-411a-af32-7e2579b09de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:15:50 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Volume volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88 (4ea646b4-1ba8-411a-b669-f4ad868e7c88): created successfully
Nov 05 04:15:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5dc93d-fd98-411a-af32-7e2579b09de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:15:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Flow 'volume_create_manager' (639ac930-8a04-4b46-9d1a-458724a15a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:15:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6c6e82e1-bbb0-4862-94fc-6042aaa7abd1 tempest-AttachVolumeShelveTestJSON-823442312 None] Created volume successfully.
Nov 05 04:15:51 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 05 04:15:51 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 05 04:15:51 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 05 04:15:51 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 04:15:51 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 05 04:15:51 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 05 04:15:51 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 05 04:15:51 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 05 04:15:51 devstack cinder-volume[87166]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 05 04:15:51 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root
Nov 05 04:15:51 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Spawned new privsep daemon via rootwrap
Nov 05 04:15:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Accepted privsep connection to /tmp/tmp85mz9z_w/privsep.sock {{(pid=87166) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 05 04:15:51 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 05 04:15:51 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 05 04:15:51 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 05 04:15:51 devstack cinder-volume[87166]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88717
Nov 05 04:15:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fa95cf-4790-4728-8487-69b5a92a5da2]: (2,) {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:15:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ef59d-3a5c-485f-846e-7a1f7ef0f289]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:15:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:15:51 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa
Nov 05 04:15:51 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:15:51 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Nov 05 04:15:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa" returned: 0 in 0.547s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:15:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:15:51 devstack sudo[88728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa
Nov 05 04:15:51 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:15:52 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ac685218-5ba4-4a64-a040-9b048db69caa" returned: 0 in 0.291s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "cinder-quobyte-ac685218-5ba4-4a64-a040-9b048db69caa" released by "delete_volume" :: held 2.113s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:15:52 devstack cinder-volume[87166]: WARNING cinder.quota [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:15:52 devstack cinder-volume[87166]: WARNING cinder.quota [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Created reservations ['7c29c334-bd4d-4dca-84c2-48badd895a89', '4536b4ac-8c1f-4501-84a6-678359b5a2c2', 'a8839616-63eb-4be0-a1db-153bbf2e5523', '4d2d54a0-69df-4baf-a625-db5c5a15d0ae'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:15:52 devstack sudo[88731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:15:52 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:15:52 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.320s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:15:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Deleted volume successfully.
Nov 05 04:15:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74ba81b-e9ac-4456-b8dd-c1d436fc08fa tempest-ServerRescueNegativeTestJSON-2081035948 None] Lock "cinder-ac685218-5ba4-4a64-a040-9b048db69caa-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:16:02 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:16:02 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Flow 'volume_create_manager' (b482603a-483f-4be0-8405-aace487a7b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1f2d3c-05cf-4b6b-a6c2-a372b8a83847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1f2d3c-05cf-4b6b-a6c2-a372b8a83847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-120719170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fa90f6-6f32-4348-8194-3ea610979a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d97738a1cb240a4a6202c1dcb32434d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:16:05Z,use_quota=True,user_id='90a011558e9843fd95e73256d5455449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b241e8-6256-4144-892d-0a8528df36ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b241e8-6256-4144-892d-0a8528df36ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2a2785-6fd7-4aca-b755-0999ddb14cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2a2785-6fd7-4aca-b755-0999ddb14cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71fa90f6-6f32-4348-8194-3ea610979a9a', 'volume_name': 'volume-71fa90f6-6f32-4348-8194-3ea610979a9a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50db8cc7-87f3-4185-9869-a165c6ce7ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50db8cc7-87f3-4185-9869-a165c6ce7ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14949ca3-c63f-4fc5-b106-c72cb9f81ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Volume 71fa90f6-6f32-4348-8194-3ea610979a9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71fa90f6-6f32-4348-8194-3ea610979a9a', 'volume_size': 1}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-120719170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71fa90f6-6f32-4348-8194-3ea610979a9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d97738a1cb240a4a6202c1dcb32434d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:16:05Z,use_quota=True,user_id='90a011558e9843fd95e73256d5455449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Creating volume 71fa90f6-6f32-4348-8194-3ea610979a9a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:16:05 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:16:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:16:05 devstack sudo[88828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a 1073741824
Nov 05 04:16:05 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:16:06 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root
Nov 05 04:16:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a 1073741824" returned: 0 in 0.610s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:16:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:16:06 devstack sudo[88833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a
Nov 05 04:16:06 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:16:06 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root
Nov 05 04:16:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a" returned: 0 in 0.328s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:16:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:16:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:16:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14949ca3-c63f-4fc5-b106-c72cb9f81ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71fa90f6-6f32-4348-8194-3ea610979a9a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ecd4d0-7829-4ccd-aac3-ff2f8fa7b7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Volume volume-71fa90f6-6f32-4348-8194-3ea610979a9a (71fa90f6-6f32-4348-8194-3ea610979a9a): created successfully
Nov 05 04:16:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ecd4d0-7829-4ccd-aac3-ff2f8fa7b7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Flow 'volume_create_manager' (b482603a-483f-4be0-8405-aace487a7b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:16:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4c397dda-eca7-4cb7-97ab-665b329ca238 tempest-ServerActionsTestOtherA-1482894421 None] Created volume successfully.
Nov 05 04:16:08 devstack cinder-volume[87166]: WARNING py.warnings [req-0a0ce39f-201d-4bc4-8797-bdaf3651a327 req-eed6b1ba-edbf-4966-87bc-ecc93934744b tempest-AttachVolumeShelveTestJSON-823442312 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Nov 05 04:16:08 devstack cinder-volume[87166]:   .first()
Nov 05 04:16:08 devstack cinder-volume[87166]: 
Nov 05 04:16:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-0a0ce39f-201d-4bc4-8797-bdaf3651a327 req-eed6b1ba-edbf-4966-87bc-ecc93934744b tempest-AttachVolumeShelveTestJSON-823442312 None] No connector for attachment 01c806a6-8f11-4bc1-a4ab-bbf0ae1dab3e; skipping storage backend terminate_connection call. {{(pid=87166) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 05 04:16:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-0a0ce39f-201d-4bc4-8797-bdaf3651a327 req-eed6b1ba-edbf-4966-87bc-ecc93934744b tempest-AttachVolumeShelveTestJSON-823442312 None] Deleting attachment 01c806a6-8f11-4bc1-a4ab-bbf0ae1dab3e. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:16:26 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=5,cinder:SELECT=4 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:16:26 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:16:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:16:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:16:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:16:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:16:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:16:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:16:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:16:29 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:16:29 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:16:29 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Nov 05 04:16:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.409s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:16:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Flow 'volume_create_manager' (f30e6007-0f53-4263-add4-5344dff4100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1069baa9-4fa3-434b-8ea0-aefd29b56cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1069baa9-4fa3-434b-8ea0-aefd29b56cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1942947696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0679010f-0b4b-4e75-80c1-c91bec2ff798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5488bc385f6484ba808a7f4ce1bd898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:16:51Z,use_quota=True,user_id='d37bb98f355c49f392581161d62dc29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c326ee46-e6d2-4fd1-9c96-7f84ccdf34f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c326ee46-e6d2-4fd1-9c96-7f84ccdf34f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0ad5b9-a8bc-4322-a760-7a94bfe8bb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0ad5b9-a8bc-4322-a760-7a94bfe8bb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0679010f-0b4b-4e75-80c1-c91bec2ff798', 'volume_name': 'volume-0679010f-0b4b-4e75-80c1-c91bec2ff798', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f93d5-fa53-4609-b0cd-fd18cdb713f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f93d5-fa53-4609-b0cd-fd18cdb713f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4333adcc-4c9f-4d85-a94b-ca05fa453ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Volume 0679010f-0b4b-4e75-80c1-c91bec2ff798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0679010f-0b4b-4e75-80c1-c91bec2ff798', 'volume_size': 1}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1942947696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0679010f-0b4b-4e75-80c1-c91bec2ff798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5488bc385f6484ba808a7f4ce1bd898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:16:51Z,use_quota=True,user_id='d37bb98f355c49f392581161d62dc29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Creating volume 0679010f-0b4b-4e75-80c1-c91bec2ff798 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:16:51 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:16:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:16:51 devstack sudo[89306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798 1073741824
Nov 05 04:16:51 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:16:52 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root
Nov 05 04:16:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798 1073741824" returned: 0 in 0.863s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:16:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:16:52 devstack sudo[89315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798
Nov 05 04:16:52 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:16:53 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root
Nov 05 04:16:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798" returned: 0 in 0.541s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:16:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:16:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:16:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4333adcc-4c9f-4d85-a94b-ca05fa453ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0679010f-0b4b-4e75-80c1-c91bec2ff798', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5271421-198b-47b5-82d0-f9eb5ac52b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:16:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Volume volume-0679010f-0b4b-4e75-80c1-c91bec2ff798 (0679010f-0b4b-4e75-80c1-c91bec2ff798): created successfully
Nov 05 04:16:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5271421-198b-47b5-82d0-f9eb5ac52b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:16:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Flow 'volume_create_manager' (f30e6007-0f53-4263-add4-5344dff4100e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:16:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3bae4208-cf3b-432c-bbe8-40ced4525bc4 tempest-VolumesAdminNegativeTest-749219221 None] Created volume successfully.
Nov 05 04:16:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Acquiring lock "cinder-0679010f-0b4b-4e75-80c1-c91bec2ff798-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:16:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Lock "cinder-0679010f-0b4b-4e75-80c1-c91bec2ff798-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:16:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Acquiring lock "cinder-quobyte-0679010f-0b4b-4e75-80c1-c91bec2ff798" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:16:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Lock "cinder-quobyte-0679010f-0b4b-4e75-80c1-c91bec2ff798" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:16:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6a763d-2f1d-4c88-b04b-1df5eb33c777]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:16:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:16:54 devstack sudo[89324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798
Nov 05 04:16:54 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:16:55 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root
Nov 05 04:16:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798" returned: 0 in 0.693s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:16:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:16:55 devstack sudo[89340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798
Nov 05 04:16:55 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:16:56 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root
Nov 05 04:16:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0679010f-0b4b-4e75-80c1-c91bec2ff798" returned: 0 in 0.620s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:16:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Lock "cinder-quobyte-0679010f-0b4b-4e75-80c1-c91bec2ff798" released by "delete_volume" :: held 1.422s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:16:56 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Created reservations ['b246bf57-f1ff-4eeb-a156-a0d235898b26', '79e4fe0c-ad63-48f2-a06b-00b797391fe5', '7aa959e2-5031-449c-a962-9568a5e73a15', '66bcce81-f121-4649-bbce-bed1ab4ff2f1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:16:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:16:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:16:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:16:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:16:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:16:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:16:56 devstack sudo[89343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:16:56 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:16:57 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root
Nov 05 04:16:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.690s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:16:57 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:16:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Deleted volume successfully.
Nov 05 04:16:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cce2836e-760f-4264-b7cc-b9e20d8a8138 tempest-VolumesAdminNegativeTest-749219221 None] Lock "cinder-0679010f-0b4b-4e75-80c1-c91bec2ff798-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-a00fd3d2-f68c-4f08-9c03-60c7425c0fa1 req-42d6fc98-3cb6-4390-b454-51ba5d1d662e tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-a00fd3d2-f68c-4f08-9c03-60c7425c0fa1 req-42d6fc98-3cb6-4390-b454-51ba5d1d662e tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-a00fd3d2-f68c-4f08-9c03-60c7425c0fa1 req-42d6fc98-3cb6-4390-b454-51ba5d1d662e tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-a00fd3d2-f68c-4f08-9c03-60c7425c0fa1 req-42d6fc98-3cb6-4390-b454-51ba5d1d662e tempest-ServerActionsTestOtherA-1482894421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-71fa90f6-6f32-4348-8194-3ea610979a9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5740220e-1253-45b1-a0c1-ff6c0d2ccd41', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:17:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-a00fd3d2-f68c-4f08-9c03-60c7425c0fa1 req-42d6fc98-3cb6-4390-b454-51ba5d1d662e tempest-ServerActionsTestOtherA-1482894421 None] attachment_update completed successfully.
Nov 05 04:17:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-9d75361d-ccd6-49b8-8a07-2071521f76db req-af1a21e9-db3c-4447-89e3-8afde9cd282e tempest-ServerActionsTestOtherA-1482894421 None] Terminate volume connection completed successfully.
Nov 05 04:17:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-9d75361d-ccd6-49b8-8a07-2071521f76db req-af1a21e9-db3c-4447-89e3-8afde9cd282e tempest-ServerActionsTestOtherA-1482894421 None] Deleting attachment 5740220e-1253-45b1-a0c1-ff6c0d2ccd41. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Flow 'volume_create_manager' (2a6887fd-d5a2-4ecf-a15a-539b7acc0d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d77c76-ab76-4cc1-a58a-e3e9208d7688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d77c76-ab76-4cc1-a58a-e3e9208d7688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-247743208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5412498-3989-4b5b-be10-2840461f8992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f24e3c0466b41808af6b10d19cd5f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:17:10Z,use_quota=True,user_id='72d56ecac37c4515b5d6e259f050d142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cffad6-40ee-4642-a206-ecf261ae85a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06cffad6-40ee-4642-a206-ecf261ae85a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf5a07c-da2c-43d2-9a89-33a655e45ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf5a07c-da2c-43d2-9a89-33a655e45ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5412498-3989-4b5b-be10-2840461f8992', 'volume_name': 'volume-e5412498-3989-4b5b-be10-2840461f8992', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d117c3d9-1bba-4d03-96d3-faddf0c69d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d117c3d9-1bba-4d03-96d3-faddf0c69d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b85378-1dc4-4dab-a9af-ad95ecd04693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Volume e5412498-3989-4b5b-be10-2840461f8992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5412498-3989-4b5b-be10-2840461f8992', 'volume_size': 1}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-247743208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5412498-3989-4b5b-be10-2840461f8992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f24e3c0466b41808af6b10d19cd5f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:17:10Z,use_quota=True,user_id='72d56ecac37c4515b5d6e259f050d142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Creating volume e5412498-3989-4b5b-be10-2840461f8992 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:17:10 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:17:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:10 devstack sudo[89978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992 1073741824
Nov 05 04:17:10 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-9d75361d-ccd6-49b8-8a07-2071521f76db req-a1c6c7dd-cb49-4aa6-a812-7aebbab441eb tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:11 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992 1073741824" returned: 0 in 0.641s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:11 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992
Nov 05 04:17:11 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:11 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992" returned: 0 in 0.320s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-9d75361d-ccd6-49b8-8a07-2071521f76db req-a1c6c7dd-cb49-4aa6-a812-7aebbab441eb tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.474s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41b85378-1dc4-4dab-a9af-ad95ecd04693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5412498-3989-4b5b-be10-2840461f8992', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cc383b-cfdf-4852-b276-e8b697031b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-9d75361d-ccd6-49b8-8a07-2071521f76db req-a1c6c7dd-cb49-4aa6-a812-7aebbab441eb tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.119s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Volume volume-e5412498-3989-4b5b-be10-2840461f8992 (e5412498-3989-4b5b-be10-2840461f8992): created successfully
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cc383b-cfdf-4852-b276-e8b697031b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Flow 'volume_create_manager' (2a6887fd-d5a2-4ecf-a15a-539b7acc0d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:17:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-65a87164-e153-485e-9fed-f95b75d53b09 tempest-ServersNegativeTestJSON-1710847939 None] Created volume successfully.
Nov 05 04:17:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-9d75361d-ccd6-49b8-8a07-2071521f76db req-a1c6c7dd-cb49-4aa6-a812-7aebbab441eb tempest-ServerActionsTestOtherA-1482894421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-71fa90f6-6f32-4348-8194-3ea610979a9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84abed37-c108-415a-8ada-c795e8a23adb', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:17:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-9d75361d-ccd6-49b8-8a07-2071521f76db req-a1c6c7dd-cb49-4aa6-a812-7aebbab441eb tempest-ServerActionsTestOtherA-1482894421 None] attachment_update completed successfully.
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Flow 'volume_create_manager' (5ff972eb-6879-4ba1-b71d-a64874abfde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b996e92-a75a-4983-887e-3fa3f87ccdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b996e92-a75a-4983-887e-3fa3f87ccdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-420734584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b953bc7b-dd93-4534-9b44-461eebb77a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f24e3c0466b41808af6b10d19cd5f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:17:14Z,use_quota=True,user_id='72d56ecac37c4515b5d6e259f050d142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673ae9e4-4c1c-44d0-8e44-2befcbb70460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673ae9e4-4c1c-44d0-8e44-2befcbb70460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab2304a-0249-4918-a993-0d212fa47e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab2304a-0249-4918-a993-0d212fa47e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b953bc7b-dd93-4534-9b44-461eebb77a4d', 'volume_name': 'volume-b953bc7b-dd93-4534-9b44-461eebb77a4d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35306e20-1ec3-494c-9892-9e910c1badce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35306e20-1ec3-494c-9892-9e910c1badce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c070e109-7f1f-4ece-80ab-224a762a854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Volume b953bc7b-dd93-4534-9b44-461eebb77a4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b953bc7b-dd93-4534-9b44-461eebb77a4d', 'volume_size': 1}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-420734584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b953bc7b-dd93-4534-9b44-461eebb77a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f24e3c0466b41808af6b10d19cd5f05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:17:14Z,use_quota=True,user_id='72d56ecac37c4515b5d6e259f050d142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Creating volume b953bc7b-dd93-4534-9b44-461eebb77a4d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:17:14 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:14 devstack sudo[90470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d 1073741824
Nov 05 04:17:14 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:14 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d 1073741824" returned: 0 in 0.542s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:14 devstack sudo[90482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d
Nov 05 04:17:14 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:15 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:17:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c070e109-7f1f-4ece-80ab-224a762a854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b953bc7b-dd93-4534-9b44-461eebb77a4d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd140a5-e74f-4cbd-bb41-54b9c936a886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Volume volume-b953bc7b-dd93-4534-9b44-461eebb77a4d (b953bc7b-dd93-4534-9b44-461eebb77a4d): created successfully
Nov 05 04:17:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd140a5-e74f-4cbd-bb41-54b9c936a886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Flow 'volume_create_manager' (5ff972eb-6879-4ba1-b71d-a64874abfde0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:17:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8c14a9ca-0878-4f31-8585-1b562f97fb7d tempest-ServersNegativeTestJSON-1710847939 None] Created volume successfully.
Nov 05 04:17:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "cinder-b953bc7b-dd93-4534-9b44-461eebb77a4d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Lock "cinder-b953bc7b-dd93-4534-9b44-461eebb77a4d-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "cinder-quobyte-b953bc7b-dd93-4534-9b44-461eebb77a4d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Lock "cinder-quobyte-b953bc7b-dd93-4534-9b44-461eebb77a4d" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45caf76-ad68-4251-99c4-dcf49bb6707e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:17:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:17 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d
Nov 05 04:17:17 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:17 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d" returned: 0 in 0.683s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:17 devstack sudo[90527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d
Nov 05 04:17:17 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:18 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b953bc7b-dd93-4534-9b44-461eebb77a4d" returned: 0 in 0.473s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Lock "cinder-quobyte-b953bc7b-dd93-4534-9b44-461eebb77a4d" released by "delete_volume" :: held 1.264s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Created reservations ['c94688b2-3889-42a5-9687-5628f8d043a3', 'b7e27e0e-1f14-44f3-b6e2-f553256b2a15', '5376d28d-e292-4667-8593-77f5a31718a5', '72179873-4616-4c42-865e-4e1c6443ac98'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:18 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:17:18 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:18 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:17:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Deleted volume successfully.
Nov 05 04:17:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4a5c0901-9a79-4dd4-a23e-f0dfb4fdd1c2 tempest-ServersNegativeTestJSON-1710847939 None] Lock "cinder-b953bc7b-dd93-4534-9b44-461eebb77a4d-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "cinder-e5412498-3989-4b5b-be10-2840461f8992-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Lock "cinder-e5412498-3989-4b5b-be10-2840461f8992-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "cinder-quobyte-e5412498-3989-4b5b-be10-2840461f8992" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Lock "cinder-quobyte-e5412498-3989-4b5b-be10-2840461f8992" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0304080-3a49-478c-a69b-1aeb7eb5453b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:17:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:19 devstack sudo[90539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992
Nov 05 04:17:19 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:19 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992" returned: 0 in 0.419s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:19 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992
Nov 05 04:17:19 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:19 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e5412498-3989-4b5b-be10-2840461f8992" returned: 0 in 0.258s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Lock "cinder-quobyte-e5412498-3989-4b5b-be10-2840461f8992" released by "delete_volume" :: held 0.739s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Created reservations ['3a6c9da0-7529-4d03-aa7e-db01b334fc61', '6bdccccb-63a1-4474-af98-ddedd02cffbf', 'c67c3f9d-bf66-4c02-82d4-115ba1ccf125', '60defce0-9e42-4ed0-93d7-60d754ccff2f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:20 devstack sudo[90547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:17:20 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:20 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.296s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:17:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Deleted volume successfully.
Nov 05 04:17:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c75a0fd6-07af-4c7b-9718-a4bb23116d1f tempest-ServersNegativeTestJSON-1710847939 None] Lock "cinder-e5412498-3989-4b5b-be10-2840461f8992-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Acquiring lock "cinder-4ea646b4-1ba8-411a-b669-f4ad868e7c88-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "cinder-4ea646b4-1ba8-411a-b669-f4ad868e7c88-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Acquiring lock "cinder-quobyte-4ea646b4-1ba8-411a-b669-f4ad868e7c88" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "cinder-quobyte-4ea646b4-1ba8-411a-b669-f4ad868e7c88" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:28 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6f82f5-9c09-4e25-ab29-df66d36678bb]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:17:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:28 devstack sudo[90644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88
Nov 05 04:17:28 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:28 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88" returned: 0 in 0.584s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:28 devstack sudo[90667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88
Nov 05 04:17:28 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:29 devstack sudo[90675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:17:29 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:29 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4ea646b4-1ba8-411a-b669-f4ad868e7c88" returned: 0 in 0.378s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "cinder-quobyte-4ea646b4-1ba8-411a-b669-f4ad868e7c88" released by "delete_volume" :: held 1.044s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Created reservations ['ec5600f3-8109-4f51-9bd2-093a556d9233', '0155a5fc-b41e-4d34-b3b8-b0b12460d900', 'e5873038-17f5-415e-8589-59dd6a785201', '189de7ba-655d-4f83-8c86-7bc7a9a96c61'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:29 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.377s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 8 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:17:29 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:17:29 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:29 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.280s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:17:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Deleted volume successfully.
Nov 05 04:17:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b481213-389a-49a3-a4dd-26f5adddbbcb tempest-AttachVolumeShelveTestJSON-823442312 None] Lock "cinder-4ea646b4-1ba8-411a-b669-f4ad868e7c88-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:39 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=43,cinder:UPDATE=42,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:17:39 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=46,cinder:SELECT=37,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Flow 'volume_create_manager' (d17b1d89-f878-4a46-b8af-7049ec5f848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1539cb68-327e-4d9f-b99b-282c9df95b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1539cb68-327e-4d9f-b99b-282c9df95b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1597415213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bfe63b-3a7a-4e71-8183-c679181361a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4c6c0f2103486fbe23ede3d70d1d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:17:44Z,use_quota=True,user_id='c501131741c145d280e1da8e44a688dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c6e278-a89b-4fe6-97b2-f8d6b23d27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c6e278-a89b-4fe6-97b2-f8d6b23d27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06831536-dd3e-426c-a0db-2e6fec265897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06831536-dd3e-426c-a0db-2e6fec265897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54bfe63b-3a7a-4e71-8183-c679181361a2', 'volume_name': 'volume-54bfe63b-3a7a-4e71-8183-c679181361a2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d53c6c-79a4-4646-bf81-c8533ca0485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5d53c6c-79a4-4646-bf81-c8533ca0485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21df1c63-51d3-4bbb-bfb1-c5b8b500f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Volume 54bfe63b-3a7a-4e71-8183-c679181361a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54bfe63b-3a7a-4e71-8183-c679181361a2', 'volume_size': 1}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1597415213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54bfe63b-3a7a-4e71-8183-c679181361a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee4c6c0f2103486fbe23ede3d70d1d5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:17:44Z,use_quota=True,user_id='c501131741c145d280e1da8e44a688dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Creating volume 54bfe63b-3a7a-4e71-8183-c679181361a2 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:17:44 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:44 devstack sudo[90715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2 1073741824
Nov 05 04:17:44 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:44 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2 1073741824" returned: 0 in 0.616s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:44 devstack sudo[90721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2
Nov 05 04:17:44 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:45 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2" returned: 0 in 0.465s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:17:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21df1c63-51d3-4bbb-bfb1-c5b8b500f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54bfe63b-3a7a-4e71-8183-c679181361a2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18b8df2-4503-4fed-b779-baa88fa66e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Volume volume-54bfe63b-3a7a-4e71-8183-c679181361a2 (54bfe63b-3a7a-4e71-8183-c679181361a2): created successfully
Nov 05 04:17:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18b8df2-4503-4fed-b779-baa88fa66e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Flow 'volume_create_manager' (d17b1d89-f878-4a46-b8af-7049ec5f848b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:17:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-fc71441e-79f9-43f1-9720-4250efe5d331 req-8b7c0ab0-4fb6-48f6-a414-3c4f22b91972 tempest-VolumesSnapshotsTestJSON-953322695 None] Created volume successfully.
Nov 05 04:17:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-5e0446f8-14bc-4367-8b9a-abf72267dde9 req-c1abf89c-0027-4f8f-97a1-5a62982ec88b tempest-ServerActionsTestOtherA-1482894421 None] Terminate volume connection completed successfully.
Nov 05 04:17:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-5e0446f8-14bc-4367-8b9a-abf72267dde9 req-c1abf89c-0027-4f8f-97a1-5a62982ec88b tempest-ServerActionsTestOtherA-1482894421 None] Deleting attachment 84abed37-c108-415a-8ada-c795e8a23adb. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:17:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Creating offline snapshot 501cb534-98a2-4f58-aa03-5cd9e27a6cb2 of volume 54bfe63b-3a7a-4e71-8183-c679181361a2 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:17:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b27f39-2dc1-40f3-ba3b-c2b91ac269c7]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:17:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:46 devstack sudo[90728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2
Nov 05 04:17:46 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:47 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2" returned: 0 in 0.633s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:47 devstack sudo[90737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 1G
Nov 05 04:17:47 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:48 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 1G" returned: 0 in 0.887s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54bfe63b-3a7a-4e71-8183-c679181361a2 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:48 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54bfe63b-3a7a-4e71-8183-c679181361a2 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2
Nov 05 04:17:48 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:48 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54bfe63b-3a7a-4e71-8183-c679181361a2 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2" returned: 0 in 0.618s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:48 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 is being set with open permissions: ugo+rw
Nov 05 04:17:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:48 devstack sudo[90774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2
Nov 05 04:17:48 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:49 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2" returned: 0 in 0.392s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:49 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.info
Nov 05 04:17:49 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:49 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.info" returned: 0 in 0.381s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:49 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.info is being set with open permissions: ugo+rw
Nov 05 04:17:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:49 devstack sudo[90782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.info
Nov 05 04:17:49 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:50 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.info" returned: 0 in 0.337s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.431s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-ac16685c-344d-4497-ad67-2c95e6132411 req-9a686f9a-af5f-4268-ba52-57d05337263f tempest-VolumesSnapshotsTestJSON-953322695 None] Create snapshot completed successfully
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Acquiring lock "cinder-501cb534-98a2-4f58-aa03-5cd9e27a6cb2-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-501cb534-98a2-4f58-aa03-5cd9e27a6cb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Acquiring lock "cinder-quobyte-54bfe63b-3a7a-4e71-8183-c679181361a2" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-quobyte-54bfe63b-3a7a-4e71-8183-c679181361a2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Acquiring lock "cinder-quobyte-501cb534-98a2-4f58-aa03-5cd9e27a6cb2" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-quobyte-501cb534-98a2-4f58-aa03-5cd9e27a6cb2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Deleting offline snapshot 501cb534-98a2-4f58-aa03-5cd9e27a6cb2 of volume 54bfe63b-3a7a-4e71-8183-c679181361a2 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] snapshot_file for this snap is: volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9955832e-7a13-495c-bc52-bf8c56b1620e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:17:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:51 devstack sudo[90804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2
Nov 05 04:17:51 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:51 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54bfe63b-3a7a-4e71-8183-c679181361a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:17:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c2477f-c6ae-4458-b83c-f4dfd25a9264]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:17:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:51 devstack sudo[90810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2
Nov 05 04:17:51 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:51 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:51 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2
Nov 05 04:17:51 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:52 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2" returned: 0 in 0.538s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:52 devstack sudo[90823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2
Nov 05 04:17:52 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:52 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2.501cb534-98a2-4f58-aa03-5cd9e27a6cb2" returned: 0 in 0.291s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-quobyte-501cb534-98a2-4f58-aa03-5cd9e27a6cb2" released by "_delete_snapshot" :: held 1.863s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-quobyte-54bfe63b-3a7a-4e71-8183-c679181361a2" released by "delete_snapshot" :: held 1.892s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:52 devstack cinder-volume[87166]: WARNING cinder.quota [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:17:52 devstack cinder-volume[87166]: DEBUG cinder.quota [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Created reservations ['b00606d8-4738-4e94-a2b7-f564e6257766', '0a5647ba-6a97-484f-99ca-b2e98fcfdfc2', 'bda5370e-285c-47fd-a531-f424c58a9a27', 'e8e3b0de-9791-4eb1-a400-1a7b2d8cb8c2'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:17:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Delete snapshot completed successfully.
Nov 05 04:17:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-b35085a8-ce78-4c9b-aa92-d08225db52d0 req-bc7771d4-bacd-426c-a5ff-ab276e5b6cb6 tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-501cb534-98a2-4f58-aa03-5cd9e27a6cb2-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Acquiring lock "cinder-54bfe63b-3a7a-4e71-8183-c679181361a2-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-54bfe63b-3a7a-4e71-8183-c679181361a2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Acquiring lock "cinder-quobyte-54bfe63b-3a7a-4e71-8183-c679181361a2" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:17:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-quobyte-54bfe63b-3a7a-4e71-8183-c679181361a2" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:17:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b2b72b-feea-40b6-b6f9-067bd62dd0d2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:17:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:53 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2
Nov 05 04:17:53 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:53 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2" returned: 0 in 0.460s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:54 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2
Nov 05 04:17:54 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:54 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-54bfe63b-3a7a-4e71-8183-c679181361a2" returned: 0 in 0.605s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-quobyte-54bfe63b-3a7a-4e71-8183-c679181361a2" released by "delete_volume" :: held 1.197s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:54 devstack cinder-volume[87166]: DEBUG cinder.quota [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Created reservations ['2a1347ed-3184-4c22-a158-ba6755e2a63a', '0cfd9da8-dcb2-46e5-a38e-3b6bbed9a66d', 'e3657b45-44a4-4891-8ed0-3d120df449cc', '35621a7c-b3b9-4d08-92db-e3d6f5b2cba1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:17:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:17:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:17:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:17:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:17:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:17:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:17:55 devstack sudo[90901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:17:55 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:17:55 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root
Nov 05 04:17:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:17:55 devstack cinder-volume[87166]: DEBUG cinder.manager [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:17:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Deleted volume successfully.
Nov 05 04:17:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-1fd1f5f3-defd-4029-a143-fd42f5544d38 req-c3585d5a-2f83-48ab-84d2-0a81c6602c9a tempest-VolumesSnapshotsTestJSON-953322695 None] Lock "cinder-54bfe63b-3a7a-4e71-8183-c679181361a2-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:17:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:17:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Flow 'volume_create_manager' (d58bf663-e1d3-4577-b0be-10e847aa460f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:17:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77e60e9-8c74-49a3-bdaa-8cbdb7d84b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77e60e9-8c74-49a3-bdaa-8cbdb7d84b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-979290119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63601796-e961-47b3-825e-44b4197c7bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d97738a1cb240a4a6202c1dcb32434d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:17:58Z,use_quota=True,user_id='90a011558e9843fd95e73256d5455449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86fa1a2a-1c96-42eb-81cc-30e21038fb58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86fa1a2a-1c96-42eb-81cc-30e21038fb58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6541383b-b033-4e9f-b19a-f00d1e71ace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:58 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:17:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6541383b-b033-4e9f-b19a-f00d1e71ace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63601796-e961-47b3-825e-44b4197c7bd1', 'volume_name': 'volume-63601796-e961-47b3-825e-44b4197c7bd1', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f238c410>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac6cd74-3cbb-44f6-a016-829e1217933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac6cd74-3cbb-44f6-a016-829e1217933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:17:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22edef2-0fc7-4bd9-b835-4ecc0e97ce51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:17:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Volume 63601796-e961-47b3-825e-44b4197c7bd1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63601796-e961-47b3-825e-44b4197c7bd1', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f238c410>}
Nov 05 04:17:59 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Trying to clone 63601796-e961-47b3-825e-44b4197c7bd1 from image 6ded3d1d-d482-4fc8-985e-41c27b256803 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:17:59 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:17:59 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 04:17:59 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:17:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Flow 'volume_create_manager' (17387c44-e4db-4700-b4bc-a5d8067f0b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:17:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb219095-675b-47d4-aaf7-cb1df0d79cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce3800-ff2a-48b7-95ac-f742f95967eb]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb219095-675b-47d4-aaf7-cb1df0d79cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1473162582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e290eda-b5d8-49a4-9df3-cd7e2cb0f285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58592e226a04ee2ab5d244384a7b3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:18:00Z,use_quota=True,user_id='0297c8d2fd064865bdf15a0feaa9248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc86ba1-3e31-45a7-9671-2c73d8996298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc86ba1-3e31-45a7-9671-2c73d8996298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87878f00-9732-4b05-bd96-5dd1029f663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87878f00-9732-4b05-bd96-5dd1029f663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e290eda-b5d8-49a4-9df3-cd7e2cb0f285', 'volume_name': 'volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e587cc05-7ac5-40a8-95ad-621ab16ac58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e587cc05-7ac5-40a8-95ad-621ab16ac58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e86d85-9c42-4124-9659-0345f9b2cf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Volume 5e290eda-b5d8-49a4-9df3-cd7e2cb0f285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285', 'volume_size': 1}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1473162582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e290eda-b5d8-49a4-9df3-cd7e2cb0f285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58592e226a04ee2ab5d244384a7b3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:18:00Z,use_quota=True,user_id='0297c8d2fd064865bdf15a0feaa9248b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Creating volume 5e290eda-b5d8-49a4-9df3-cd7e2cb0f285 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:18:00 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:00 devstack sudo[90956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285 1073741824
Nov 05 04:18:00 devstack sudo[90955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD
Nov 05 04:18:00 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:00 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:00 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 is fetched for user 90a011558e9843fd95e73256d5455449. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d80d43-812e-42ad-9223-695f5d680086]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:00 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD
Nov 05 04:18:00 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:00 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285 1073741824" returned: 0 in 0.760s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:01 devstack sudo[90969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285
Nov 05 04:18:01 devstack sudo[90969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:01 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:01 devstack sudo[90969]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285" returned: 0 in 0.536s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] <== create_volume: return (1388ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-979290119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63601796-e961-47b3-825e-44b4197c7bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d97738a1cb240a4a6202c1dcb32434d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:17:58Z,use_quota=True,user_id='90a011558e9843fd95e73256d5455449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Creating volume 63601796-e961-47b3-825e-44b4197c7bd1 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:18:01 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:01 devstack sudo[90976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 1073741824
Nov 05 04:18:01 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e86d85-9c42-4124-9659-0345f9b2cf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d722ff2-2728-4b9a-9656-55c1dbb29328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Volume volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285 (5e290eda-b5d8-49a4-9df3-cd7e2cb0f285): created successfully
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d722ff2-2728-4b9a-9656-55c1dbb29328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Flow 'volume_create_manager' (17387c44-e4db-4700-b4bc-a5d8067f0b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:18:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f436d49b-b5a4-4a36-ba2f-cd7890081a30 tempest-DeleteServersTestJSON-377750030 None] Created volume successfully.
Nov 05 04:18:02 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 1073741824" returned: 0 in 0.779s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:02 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1
Nov 05 04:18:02 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:03 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1" returned: 0 in 0.952s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:18:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:03 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Attempting download of 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume 63601796-e961-47b3-825e-44b4197c7bd1. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:18:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c2a44f-de96-4a2a-99b5-4299f6bb8eb3]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:18:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_mqbwe00i {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:03 devstack sudo[91046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_mqbwe00i
Nov 05 04:18:03 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:04 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_mqbwe00i" returned: 0 in 1.238s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_mqbwe00i {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:05 devstack sudo[91065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_mqbwe00i
Nov 05 04:18:05 devstack sudo[91065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-5dcb7298-5449-4f9c-879a-b433bede8c17 req-f7843947-3013-48de-869b-2bacb499e646 tempest-DeleteServersTestJSON-377750030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-5dcb7298-5449-4f9c-879a-b433bede8c17 req-f7843947-3013-48de-869b-2bacb499e646 tempest-DeleteServersTestJSON-377750030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-5dcb7298-5449-4f9c-879a-b433bede8c17 req-f7843947-3013-48de-869b-2bacb499e646 tempest-DeleteServersTestJSON-377750030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-5dcb7298-5449-4f9c-879a-b433bede8c17 req-f7843947-3013-48de-869b-2bacb499e646 tempest-DeleteServersTestJSON-377750030 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ac75283-6994-4e0b-89c3-fc590b33abfb', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:18:05 devstack sudo[91065]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_mqbwe00i" returned: 1 in 0.902s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_mqbwe00i' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:18:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1309d5b-7fff-4d91-b52d-0db6de336d07]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:18:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-5dcb7298-5449-4f9c-879a-b433bede8c17 req-f7843947-3013-48de-869b-2bacb499e646 tempest-DeleteServersTestJSON-377750030 None] attachment_update completed successfully.
Nov 05 04:18:06 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD
Nov 05 04:18:06 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:06 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD" returned: 0 in 1.107s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:06 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] 6ded3d1d-d482-4fc8-985e-41c27b256803 was qcow2, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:18:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:06 devstack sudo[91500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1
Nov 05 04:18:06 devstack sudo[91500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:10 devstack sudo[91500]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1" returned: 0 in 3.670s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:10 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_22eaal0xdevstack@QuobyteHD, size 112.00 MB, duration 3.67 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:18:10 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Converted 112.00 MB image at 30.48 MB/s
Nov 05 04:18:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:10 devstack sudo[91556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 1G
Nov 05 04:18:10 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-9034293d-22b6-4503-9563-bc80545204de req-c9c845f9-80d9-4bb0-aea4-27f6813fefde tempest-DeleteServersTestJSON-377750030 None] Terminate volume connection completed successfully.
Nov 05 04:18:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-9034293d-22b6-4503-9563-bc80545204de req-c9c845f9-80d9-4bb0-aea4-27f6813fefde tempest-DeleteServersTestJSON-377750030 None] Deleting attachment 6ac75283-6994-4e0b-89c3-fc590b33abfb. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:18:11 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 1G" returned: 0 in 0.606s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Downloaded image 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume 63601796-e961-47b3-825e-44b4197c7bd1 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 for user 90a011558e9843fd95e73256d5455449 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Marking volume 63601796-e961-47b3-825e-44b4197c7bd1 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Copying metadata from image 6ded3d1d-d482-4fc8-985e-41c27b256803 to 63601796-e961-47b3-825e-44b4197c7bd1. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Creating volume glance metadata for volume 63601796-e961-47b3-825e-44b4197c7bd1 backed by image 6ded3d1d-d482-4fc8-985e-41c27b256803 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22edef2-0fc7-4bd9-b835-4ecc0e97ce51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63601796-e961-47b3-825e-44b4197c7bd1', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f238c410>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec1e722-9632-40d2-9815-b6064382221a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Volume volume-63601796-e961-47b3-825e-44b4197c7bd1 (63601796-e961-47b3-825e-44b4197c7bd1): created successfully
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec1e722-9632-40d2-9815-b6064382221a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Flow 'volume_create_manager' (d58bf663-e1d3-4577-b0be-10e847aa460f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:18:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-08ed415b-572c-4664-a180-c5107aca5772 tempest-ServerActionsTestOtherA-1482894421 None] Created volume successfully.
Nov 05 04:18:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Acquiring lock "cinder-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:18:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Lock "cinder-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:18:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Acquiring lock "cinder-quobyte-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:18:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Lock "cinder-quobyte-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:18:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[69110f7a-7545-43a2-84a4-037640152eb9]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:18:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:12 devstack sudo[91570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285
Nov 05 04:18:12 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:13 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285" returned: 0 in 0.637s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:13 devstack sudo[91580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285
Nov 05 04:18:13 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:13 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285" returned: 0 in 0.556s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Lock "cinder-quobyte-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285" released by "delete_volume" :: held 1.249s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:18:14 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Created reservations ['e33a41af-0c73-4cc6-add6-47f36c89f6fb', '7067d64b-3d3f-483b-aa70-97757d2b58e8', '2a21914c-5a00-43e7-9664-3d7e1f915723', '4449a8ff-2088-4580-9bd6-346042ca404e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:18:14 devstack cinder-volume[87166]: DEBUG oslo_db.api [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] DB error: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction')
Nov 05 04:18:14 devstack cinder-volume[87166]: [SQL: SELECT reservations.id AS reservations_id, reservations.uuid AS reservations_uuid, reservations.usage_id AS reservations_usage_id, reservations.project_id AS reservations_project_id, reservations.resource AS reservations_resource, reservations.delta AS reservations_delta, reservations.expire AS reservations_expire, reservations.deleted_at AS reservations_deleted_at, reservations.deleted AS reservations_deleted, reservations.created_at AS reservations_created_at, reservations.updated_at AS reservations_updated_at
Nov 05 04:18:14 devstack cinder-volume[87166]: FROM reservations
Nov 05 04:18:14 devstack cinder-volume[87166]: WHERE reservations.deleted = false AND reservations.uuid IN (%(uuid_1_1)s, %(uuid_1_2)s, %(uuid_1_3)s, %(uuid_1_4)s) FOR UPDATE]
Nov 05 04:18:14 devstack cinder-volume[87166]: [parameters: {'uuid_1_1': 'e33a41af-0c73-4cc6-add6-47f36c89f6fb', 'uuid_1_2': '7067d64b-3d3f-483b-aa70-97757d2b58e8', 'uuid_1_3': '2a21914c-5a00-43e7-9664-3d7e1f915723', 'uuid_1_4': '4449a8ff-2088-4580-9bd6-346042ca404e'}]
Nov 05 04:18:14 devstack cinder-volume[87166]: (Background on this error at: https://sqlalche.me/e/20/e3q8) {{(pid=87166) _is_exception_expected /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:184}}
Nov 05 04:18:14 devstack cinder-volume[87166]: DEBUG oslo_db.api [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Performing DB retry for function cinder.db.api.reservation_commit {{(pid=87166) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}}
Nov 05 04:18:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-088f4368-f94a-476d-9513-a5e5179b1a36 tempest-GroupSnapshotsV319Test-1112208573 None] Group tempest-GroupSnapshotsV319Test-Group-343872081: creating
Nov 05 04:18:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-088f4368-f94a-476d-9513-a5e5179b1a36 tempest-GroupSnapshotsV319Test-1112208573 None] Group tempest-GroupSnapshotsV319Test-Group-343872081: created successfully
Nov 05 04:18:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-088f4368-f94a-476d-9513-a5e5179b1a36 tempest-GroupSnapshotsV319Test-1112208573 None] Create group completed successfully.
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:15 devstack sudo[91586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:18:15 devstack sudo[91586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:15 devstack sudo[91586]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.512s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:18:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Deleted volume successfully.
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-395d0e29-fede-4756-a6d4-2e12103d922a tempest-DeleteServersTestJSON-377750030 None] Lock "cinder-5e290eda-b5d8-49a4-9df3-cd7e2cb0f285-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-b2b07456-172c-4838-a9ba-f99b8f00135a req-c154db2d-c309-4f83-be9e-ba030c693315 tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-b2b07456-172c-4838-a9ba-f99b8f00135a req-c154db2d-c309-4f83-be9e-ba030c693315 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-b2b07456-172c-4838-a9ba-f99b8f00135a req-c154db2d-c309-4f83-be9e-ba030c693315 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-b2b07456-172c-4838-a9ba-f99b8f00135a req-c154db2d-c309-4f83-be9e-ba030c693315 tempest-ServerActionsTestOtherA-1482894421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-63601796-e961-47b3-825e-44b4197c7bd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03a1ce26-6558-4770-9651-18fa78bb5e17', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:18:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-b2b07456-172c-4838-a9ba-f99b8f00135a req-c154db2d-c309-4f83-be9e-ba030c693315 tempest-ServerActionsTestOtherA-1482894421 None] attachment_update completed successfully.
Nov 05 04:18:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Flow 'volume_create_manager' (2ee376dc-24e9-48ec-b811-a3f7af94caf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bddfe76-6f0e-4075-93e5-f971dd64f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bddfe76-6f0e-4075-93e5-f971dd64f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-804633207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df57bace-9622-4645-9d6c-17d4da264922,host='devstack@QuobyteHD#QuobyteHD',id=b686daea-12d6-47b0-85f6-9859a7f26d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cc52d1688b4bf893a9c5381ce9335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:18:17Z,use_quota=True,user_id='3889ee7e47ad44d2a892b478e730e86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fe261e7-65a9-4dd0-9ad4-ae851df72def),volume_type_id=7fe261e7-65a9-4dd0-9ad4-ae851df72def)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24379212-9fec-448d-b9de-0fdb13dccc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24379212-9fec-448d-b9de-0fdb13dccc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73624840-89ab-48c2-b836-22c9ac43a201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73624840-89ab-48c2-b836-22c9ac43a201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b686daea-12d6-47b0-85f6-9859a7f26d09', 'volume_name': 'volume-b686daea-12d6-47b0-85f6-9859a7f26d09', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c94344-9f13-4649-bce5-c01ebf9d0e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c94344-9f13-4649-bce5-c01ebf9d0e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9eb777-b8c1-4cd8-a2ab-c6a034431378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Volume b686daea-12d6-47b0-85f6-9859a7f26d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b686daea-12d6-47b0-85f6-9859a7f26d09', 'volume_size': 1}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df57bace-9622-4645-9d6c-17d4da264922,created_at=2026-11-05T03:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-804633207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df57bace-9622-4645-9d6c-17d4da264922,host='devstack@QuobyteHD#QuobyteHD',id=b686daea-12d6-47b0-85f6-9859a7f26d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cc52d1688b4bf893a9c5381ce9335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:18:17Z,use_quota=True,user_id='3889ee7e47ad44d2a892b478e730e86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7fe261e7-65a9-4dd0-9ad4-ae851df72def),volume_type_id=7fe261e7-65a9-4dd0-9ad4-ae851df72def)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Creating volume b686daea-12d6-47b0-85f6-9859a7f26d09 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:18:17 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:17 devstack sudo[91620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09 1073741824
Nov 05 04:18:17 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:17 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09 1073741824" returned: 0 in 0.598s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:17 devstack sudo[91626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09
Nov 05 04:18:17 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:18 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:18:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9eb777-b8c1-4cd8-a2ab-c6a034431378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b686daea-12d6-47b0-85f6-9859a7f26d09', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0972d67d-aeff-4316-94ee-5f7d8d9dd5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Volume volume-b686daea-12d6-47b0-85f6-9859a7f26d09 (b686daea-12d6-47b0-85f6-9859a7f26d09): created successfully
Nov 05 04:18:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0972d67d-aeff-4316-94ee-5f7d8d9dd5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Flow 'volume_create_manager' (2ee376dc-24e9-48ec-b811-a3f7af94caf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:18:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a7a887fa-e7d3-4889-a921-883f33874ed5 tempest-GroupSnapshotsV319Test-1112208573 None] Created volume successfully.
Nov 05 04:18:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] GroupSnapshot 48574779-e8c4-4ab8-8e2d-a42f3f8f3dd7: creating.
Nov 05 04:18:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Group snapshot 48574779-e8c4-4ab8-8e2d-a42f3f8f3dd7: creating. {{(pid=87166) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 04:18:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Creating offline snapshot 31af62e2-a72a-4973-b2dd-8eeff7f5eb09 of volume b686daea-12d6-47b0-85f6-9859a7f26d09 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:18:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2a46eb-ec21-4bdb-9bfa-ec93653a4a03]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:18:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:20 devstack sudo[92087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09
Nov 05 04:18:20 devstack sudo[92087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:20 devstack sudo[92087]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09" returned: 0 in 0.440s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:20 devstack sudo[92104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 1G
Nov 05 04:18:20 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:21 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 1G" returned: 0 in 0.603s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b686daea-12d6-47b0-85f6-9859a7f26d09 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:21 devstack sudo[92111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b686daea-12d6-47b0-85f6-9859a7f26d09 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09
Nov 05 04:18:21 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:21 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b686daea-12d6-47b0-85f6-9859a7f26d09 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09" returned: 0 in 0.461s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:21 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:18:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:21 devstack sudo[92119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09
Nov 05 04:18:21 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:22 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09" returned: 0 in 0.392s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:22 devstack sudo[92156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.info
Nov 05 04:18:22 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:22 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.info" returned: 0 in 0.476s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:22 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:18:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:22 devstack sudo[92163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.info
Nov 05 04:18:22 devstack sudo[92163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:22 devstack sudo[92163]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.info" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.825s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2a12a7a3-bc14-45a9-bfe1-32c46607c9d8 tempest-GroupSnapshotsV319Test-1112208573 None] group_snapshot 48574779-e8c4-4ab8-8e2d-a42f3f8f3dd7: created successfully
Nov 05 04:18:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] group_snapshot 48574779-e8c4-4ab8-8e2d-a42f3f8f3dd7: deleting
Nov 05 04:18:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] group_snapshot 48574779-e8c4-4ab8-8e2d-a42f3f8f3dd7: deleting {{(pid=87166) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 04:18:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Acquiring lock "cinder-quobyte-b686daea-12d6-47b0-85f6-9859a7f26d09" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:18:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "cinder-quobyte-b686daea-12d6-47b0-85f6-9859a7f26d09" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:18:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Acquiring lock "cinder-quobyte-31af62e2-a72a-4973-b2dd-8eeff7f5eb09" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:18:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "cinder-quobyte-31af62e2-a72a-4973-b2dd-8eeff7f5eb09" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:18:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Deleting offline snapshot 31af62e2-a72a-4973-b2dd-8eeff7f5eb09 of volume b686daea-12d6-47b0-85f6-9859a7f26d09 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:18:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] snapshot_file for this snap is: volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:18:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16a33ed-1bf0-495e-8d8b-e2ff47bc6d93]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:18:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:24 devstack sudo[92166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09
Nov 05 04:18:24 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:25 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09" returned: 0 in 0.755s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b686daea-12d6-47b0-85f6-9859a7f26d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:18:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b814ebf2-2850-44fe-b459-d5fda7d3b55a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:18:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:25 devstack sudo[92172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09
Nov 05 04:18:25 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:26 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09" returned: 0 in 0.841s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:26 devstack sudo[92178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09
Nov 05 04:18:26 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:27 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09" returned: 0 in 0.604s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:27 devstack sudo[92191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09
Nov 05 04:18:27 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:27 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09.31af62e2-a72a-4973-b2dd-8eeff7f5eb09" returned: 0 in 0.490s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "cinder-quobyte-31af62e2-a72a-4973-b2dd-8eeff7f5eb09" released by "_delete_snapshot" :: held 2.881s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:18:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Lock "cinder-quobyte-b686daea-12d6-47b0-85f6-9859a7f26d09" released by "delete_snapshot" :: held 2.934s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:18:27 devstack cinder-volume[87166]: WARNING cinder.quota [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1696921656 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1696921656, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:18:27 devstack cinder-volume[87166]: WARNING cinder.quota [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1696921656 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1696921656, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:18:27 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] Created reservations ['44380297-3e6d-4057-8e25-74cd9cd0481c', '83940a2e-cd63-4fd2-b082-9c4b19189f94', '732b025a-03ca-45c6-81d8-a4e00d240e69', '032e815b-5d4e-4878-b0cb-88c29476a7ac'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:18:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-125389ab-fdae-465b-919a-ab092921fca2 tempest-GroupSnapshotsV319Test-1112208573 None] group_snapshot 48574779-e8c4-4ab8-8e2d-a42f3f8f3dd7: deleted successfully
Nov 05 04:18:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Acquiring lock "cinder-quobyte-b686daea-12d6-47b0-85f6-9859a7f26d09" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:18:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Lock "cinder-quobyte-b686daea-12d6-47b0-85f6-9859a7f26d09" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeb855c-c734-4c7b-a2c1-1daa3c7c738f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:29 devstack sudo[92198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:18:29 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:29 devstack sudo[92197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09
Nov 05 04:18:29 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:29 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.456s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:18:29 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09" returned: 0 in 0.604s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:29 devstack sudo[92207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09
Nov 05 04:18:29 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:29 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b686daea-12d6-47b0-85f6-9859a7f26d09" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Lock "cinder-quobyte-b686daea-12d6-47b0-85f6-9859a7f26d09" released by "delete_volume" :: held 1.078s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Created reservations ['7762a61c-d981-4baf-b77f-7efb2427af03'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:18:30 devstack cinder-volume[87166]: WARNING cinder.quota [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1696921656 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1696921656, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Created reservations ['0710ccbf-377e-4906-a5be-09da6ceaee3b', '9bf0fe28-2edc-4261-b68b-276980f14be6', 'a38c5a7a-e98a-47d9-ae1c-89d9bd90e59a', '85f011c4-1a79-4955-b309-89b69c8ea08a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:30 devstack sudo[92212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:18:30 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:30 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:30 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:18:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-10b24f0a-18b9-4a27-ae21-b8b8b12e6c9e tempest-GroupSnapshotsV319Test-1112208573 None] Delete group completed successfully.
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Flow 'volume_create_manager' (091dd507-7040-404f-a410-0d5281c3d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b6cc2f-8eee-44e4-bc41-ebc6a31a2faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89b6cc2f-8eee-44e4-bc41-ebc6a31a2faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1117869019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d316d6-65f2-4b96-b009-464786c216d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1b61260c34ded95bd80c804791885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:18:33Z,use_quota=True,user_id='d186ccf0ebcb404ca64a79a941d5519c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee959f0-f6bf-4372-a84c-906df041789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ee959f0-f6bf-4372-a84c-906df041789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ae6635-087b-4695-a563-e16292fb6ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ae6635-087b-4695-a563-e16292fb6ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d316d6-65f2-4b96-b009-464786c216d3', 'volume_name': 'volume-b6d316d6-65f2-4b96-b009-464786c216d3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f9357e-1ef7-4dc7-a549-8983d172ffd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69f9357e-1ef7-4dc7-a549-8983d172ffd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e935acbd-254e-4884-9131-27743174d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Volume b6d316d6-65f2-4b96-b009-464786c216d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d316d6-65f2-4b96-b009-464786c216d3', 'volume_size': 1}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1117869019',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d316d6-65f2-4b96-b009-464786c216d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1b61260c34ded95bd80c804791885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:18:33Z,use_quota=True,user_id='d186ccf0ebcb404ca64a79a941d5519c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Creating volume b6d316d6-65f2-4b96-b009-464786c216d3 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:18:33 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:18:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:33 devstack sudo[92223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3 1073741824
Nov 05 04:18:33 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:33 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3 1073741824" returned: 0 in 0.722s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:18:34 devstack sudo[92272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3
Nov 05 04:18:34 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:18:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-ec2d6a04-619e-4e5e-9fc0-fe9f77d47cb5 req-52dda5f4-4156-4d9d-b051-c27bf04826f0 tempest-ServerActionsTestOtherA-1482894421 None] Terminate volume connection completed successfully.
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ec2d6a04-619e-4e5e-9fc0-fe9f77d47cb5 req-52dda5f4-4156-4d9d-b051-c27bf04826f0 tempest-ServerActionsTestOtherA-1482894421 None] Deleting attachment 03a1ce26-6558-4770-9651-18fa78bb5e17. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:18:34 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3" returned: 0 in 0.477s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e935acbd-254e-4884-9131-27743174d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d316d6-65f2-4b96-b009-464786c216d3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068d229b-730e-43e8-8ad6-d6d7deb8202e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:18:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Volume volume-b6d316d6-65f2-4b96-b009-464786c216d3 (b6d316d6-65f2-4b96-b009-464786c216d3): created successfully
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (068d229b-730e-43e8-8ad6-d6d7deb8202e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:18:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Flow 'volume_create_manager' (091dd507-7040-404f-a410-0d5281c3d5df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:18:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0f2852c9-4d94-4a5b-86ff-d6c3f36ab463 tempest-AttachVolumeTestJSON-1529889698 None] Created volume successfully.
Nov 05 04:18:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-9061bc9e-6ce4-4c0a-bbd1-923603e59667 req-b3a0d8c7-48ae-49ee-b304-65ab9fabe1ac tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-9061bc9e-6ce4-4c0a-bbd1-923603e59667 req-b3a0d8c7-48ae-49ee-b304-65ab9fabe1ac tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-9061bc9e-6ce4-4c0a-bbd1-923603e59667 req-b3a0d8c7-48ae-49ee-b304-65ab9fabe1ac tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-9061bc9e-6ce4-4c0a-bbd1-923603e59667 req-b3a0d8c7-48ae-49ee-b304-65ab9fabe1ac tempest-AttachVolumeTestJSON-1529889698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-b6d316d6-65f2-4b96-b009-464786c216d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebad8806-3af2-4a49-8e7d-f195602fa71f', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:18:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-9061bc9e-6ce4-4c0a-bbd1-923603e59667 req-b3a0d8c7-48ae-49ee-b304-65ab9fabe1ac tempest-AttachVolumeTestJSON-1529889698 None] attachment_update completed successfully.
Nov 05 04:18:40 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=85,cinder:UPDATE=61,cinder:INSERT=25,cinder:DELETE=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:18:40 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=84,cinder:UPDATE=68,cinder:DELETE=5,cinder:INSERT=16 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:18:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ec2d6a04-619e-4e5e-9fc0-fe9f77d47cb5 req-b61ad1ff-ede1-47db-b984-fbb62db026ce tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:18:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ec2d6a04-619e-4e5e-9fc0-fe9f77d47cb5 req-b61ad1ff-ede1-47db-b984-fbb62db026ce tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:18:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ec2d6a04-619e-4e5e-9fc0-fe9f77d47cb5 req-b61ad1ff-ede1-47db-b984-fbb62db026ce tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:18:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ec2d6a04-619e-4e5e-9fc0-fe9f77d47cb5 req-b61ad1ff-ede1-47db-b984-fbb62db026ce tempest-ServerActionsTestOtherA-1482894421 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-63601796-e961-47b3-825e-44b4197c7bd1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7d9f0bb-fc06-4171-8460-2536233b8288', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:18:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-ec2d6a04-619e-4e5e-9fc0-fe9f77d47cb5 req-b61ad1ff-ede1-47db-b984-fbb62db026ce tempest-ServerActionsTestOtherA-1482894421 None] attachment_update completed successfully.
Nov 05 04:18:50 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:18:50 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Flow 'volume_create_manager' (602858af-6cf2-4ec0-b9a6-62d1806f0b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f096a5b-6286-4fc3-a1ff-969633ce9bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f096a5b-6286-4fc3-a1ff-969633ce9bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1318583417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539e5d22-fa40-40e9-b4e1-fea7c436c5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8241428c58f14a7583cfddb42443793e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:04Z,use_quota=True,user_id='3c150cf7ddf04f5ea13700331e8a9bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d399a1-441d-47bd-9627-6c08c751f110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d399a1-441d-47bd-9627-6c08c751f110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba40d8a-98c4-4384-ac62-46560927102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba40d8a-98c4-4384-ac62-46560927102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '539e5d22-fa40-40e9-b4e1-fea7c436c5b3', 'volume_name': 'volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1520a9a7-11a5-4568-bf86-72533135bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1520a9a7-11a5-4568-bf86-72533135bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d85e5b-b9dd-4497-9b00-dcf58f3a0ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Volume 539e5d22-fa40-40e9-b4e1-fea7c436c5b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3', 'volume_size': 1}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1318583417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539e5d22-fa40-40e9-b4e1-fea7c436c5b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8241428c58f14a7583cfddb42443793e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:04Z,use_quota=True,user_id='3c150cf7ddf04f5ea13700331e8a9bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Creating volume 539e5d22-fa40-40e9-b4e1-fea7c436c5b3 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:19:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:19:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:03 devstack sudo[92912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3 1073741824
Nov 05 04:19:03 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:04 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3 1073741824" returned: 0 in 0.478s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:04 devstack sudo[92918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3
Nov 05 04:19:04 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:04 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3" returned: 0 in 0.239s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:19:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d85e5b-b9dd-4497-9b00-dcf58f3a0ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c0ade1-d2b0-452c-83e3-853f328fde37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Volume volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3 (539e5d22-fa40-40e9-b4e1-fea7c436c5b3): created successfully
Nov 05 04:19:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c0ade1-d2b0-452c-83e3-853f328fde37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Flow 'volume_create_manager' (602858af-6cf2-4ec0-b9a6-62d1806f0b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0f81e60f-6a89-412c-866d-bfb0683b8ae4 tempest-TaggedAttachmentsTest-769190986 None] Created volume successfully.
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Flow 'volume_create_manager' (90538ab1-36df-47d9-a19a-095a25066994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099f32e2-e166-4f45-8b10-f055a0951e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099f32e2-e166-4f45-8b10-f055a0951e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1246048102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f4fc03-72eb-4f5b-aeba-f089ce4831f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ad650c3b8451582f7f0e76aabe0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:06Z,use_quota=True,user_id='fda55285a76049e1b4ef22278ed94d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9e2f15a-4ccb-4746-8a6d-e22c7406bf8b),volume_type_id=f9e2f15a-4ccb-4746-8a6d-e22c7406bf8b)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f15c430-eb33-48a7-92aa-83b147b8341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f15c430-eb33-48a7-92aa-83b147b8341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1ae924-596b-4a19-bb68-823dee21ec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b1ae924-596b-4a19-bb68-823dee21ec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f4fc03-72eb-4f5b-aeba-f089ce4831f4', 'volume_name': 'volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6a3c39-f4df-48c0-ae25-e567827c0b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6a3c39-f4df-48c0-ae25-e567827c0b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41dbb63-7470-4391-8094-05de920be30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Volume 39f4fc03-72eb-4f5b-aeba-f089ce4831f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4', 'volume_size': 1}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1246048102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f4fc03-72eb-4f5b-aeba-f089ce4831f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='472ad650c3b8451582f7f0e76aabe0c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:06Z,use_quota=True,user_id='fda55285a76049e1b4ef22278ed94d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9e2f15a-4ccb-4746-8a6d-e22c7406bf8b),volume_type_id=f9e2f15a-4ccb-4746-8a6d-e22c7406bf8b)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Creating volume 39f4fc03-72eb-4f5b-aeba-f089ce4831f4 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:19:05 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:19:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:05 devstack sudo[92921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4 1073741824
Nov 05 04:19:05 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:06 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4 1073741824" returned: 0 in 0.445s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:06 devstack sudo[92927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4
Nov 05 04:19:06 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:06 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41dbb63-7470-4391-8094-05de920be30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0c5bf6-d92c-4db7-a0fc-6f596075fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Volume volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4 (39f4fc03-72eb-4f5b-aeba-f089ce4831f4): created successfully
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0c5bf6-d92c-4db7-a0fc-6f596075fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Flow 'volume_create_manager' (90538ab1-36df-47d9-a19a-095a25066994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-12950222-b3f0-44ab-841a-a776ae2f51ae tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Created volume successfully.
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e0a2008-fcdb-4705-a1ce-7ed87e43ca72 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e0a2008-fcdb-4705-a1ce-7ed87e43ca72 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4e0a2008-fcdb-4705-a1ce-7ed87e43ca72 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4e0a2008-fcdb-4705-a1ce-7ed87e43ca72 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e0a2008-fcdb-4705-a1ce-7ed87e43ca72 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e0a2008-fcdb-4705-a1ce-7ed87e43ca72 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:07 devstack sudo[92930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:19:07 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:07 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e0a2008-fcdb-4705-a1ce-7ed87e43ca72 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:07 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4e0a2008-fcdb-4705-a1ce-7ed87e43ca72 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:19:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4e0a2008-fcdb-4705-a1ce-7ed87e43ca72 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Retype volume completed successfully.
Nov 05 04:19:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Acquiring lock "cinder-39f4fc03-72eb-4f5b-aeba-f089ce4831f4-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:19:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "cinder-39f4fc03-72eb-4f5b-aeba-f089ce4831f4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:19:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Acquiring lock "cinder-quobyte-39f4fc03-72eb-4f5b-aeba-f089ce4831f4" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:19:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "cinder-quobyte-39f4fc03-72eb-4f5b-aeba-f089ce4831f4" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:19:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5134d071-e187-43f0-82b4-51e2e3f7d071]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:19:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:08 devstack sudo[92933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4
Nov 05 04:19:08 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:08 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:08 devstack sudo[92941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4
Nov 05 04:19:08 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:09 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-39f4fc03-72eb-4f5b-aeba-f089ce4831f4" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "cinder-quobyte-39f4fc03-72eb-4f5b-aeba-f089ce4831f4" released by "delete_volume" :: held 0.725s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:19:09 devstack cinder-volume[87166]: WARNING cinder.quota [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:19:09 devstack cinder-volume[87166]: WARNING cinder.quota [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Created reservations ['16587deb-d780-4b8a-9d50-695eacfa3c61', '3b0c7855-1cf7-4064-9890-d9ce3b34e40c', 'bb0226da-a971-4091-b41b-fa01c21d2f8a', '3c9a2407-84d7-4689-b185-d4781ab51b5b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:09 devstack sudo[92946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:19:09 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:09 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:19:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Deleted volume successfully.
Nov 05 04:19:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-40af594d-2301-4ab5-bcba-85741094b339 tempest-VolumeRetypeWithoutMigrationTest-233588578 None] Lock "cinder-39f4fc03-72eb-4f5b-aeba-f089ce4831f4-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:19:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-99c6d902-090a-46bd-887a-c0a3e6d4a3db req-f6bc1cec-8481-43c4-8b73-9a949931339a tempest-AttachVolumeTestJSON-1529889698 None] Terminate volume connection completed successfully.
Nov 05 04:19:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-99c6d902-090a-46bd-887a-c0a3e6d4a3db req-f6bc1cec-8481-43c4-8b73-9a949931339a tempest-AttachVolumeTestJSON-1529889698 None] Deleting attachment ebad8806-3af2-4a49-8e7d-f195602fa71f. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:19:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-ff372cb7-1dfe-4d7d-94f2-24a6004f9249 tempest-ServerActionsTestOtherA-1482894421 None] Terminate volume connection completed successfully.
Nov 05 04:19:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-ff372cb7-1dfe-4d7d-94f2-24a6004f9249 tempest-ServerActionsTestOtherA-1482894421 None] Deleting attachment c7d9f0bb-fc06-4171-8460-2536233b8288. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:19:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "cinder-63601796-e961-47b3-825e-44b4197c7bd1-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:19:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Lock "cinder-63601796-e961-47b3-825e-44b4197c7bd1-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:19:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "cinder-quobyte-63601796-e961-47b3-825e-44b4197c7bd1" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:19:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Lock "cinder-quobyte-63601796-e961-47b3-825e-44b4197c7bd1" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:19:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[296e520b-c992-4077-bc08-a35dc8f6ba49]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:19:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:21 devstack sudo[93213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1
Nov 05 04:19:21 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:22 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1" returned: 0 in 1.011s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:22 devstack sudo[93221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1
Nov 05 04:19:22 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:22 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-63601796-e961-47b3-825e-44b4197c7bd1" returned: 0 in 0.720s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Lock "cinder-quobyte-63601796-e961-47b3-825e-44b4197c7bd1" released by "delete_volume" :: held 1.887s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG cinder.quota [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Created reservations ['6f5e1116-7e82-447a-a44c-22e3930885fb', 'c4cd2a4b-64a3-46a8-a95c-a12231ae2177', '644045e6-cb96-42f0-a8b1-6371cf414a89', '0e26be06-3735-4263-8c25-7978765b6adb'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:23 devstack sudo[93260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:19:23 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:23 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.382s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG cinder.manager [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:19:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Deleted volume successfully.
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-9f90eb8f-12ed-40e3-9b95-bc2b9ff97a22 req-a6f640e3-f90c-43b7-8293-aaed6cbbaa65 tempest-ServerActionsTestOtherA-1482894421 None] Lock "cinder-63601796-e961-47b3-825e-44b4197c7bd1-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "cinder-71fa90f6-6f32-4348-8194-3ea610979a9a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:19:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Lock "cinder-71fa90f6-6f32-4348-8194-3ea610979a9a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:19:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "cinder-quobyte-71fa90f6-6f32-4348-8194-3ea610979a9a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:19:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Lock "cinder-quobyte-71fa90f6-6f32-4348-8194-3ea610979a9a" acquired by "delete_volume" :: waited 0.067s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:19:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f93430-8fc7-47cd-8d84-232b090719d6]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:19:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:24 devstack sudo[93265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a
Nov 05 04:19:24 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:24 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a" returned: 0 in 0.636s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:24 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a
Nov 05 04:19:24 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:25 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-71fa90f6-6f32-4348-8194-3ea610979a9a" returned: 0 in 0.532s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Lock "cinder-quobyte-71fa90f6-6f32-4348-8194-3ea610979a9a" released by "delete_volume" :: held 1.287s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:19:25 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Created reservations ['33625ec0-507a-4fc2-9f5e-2107eb5d1be4', '1f3224ac-1a4a-4c61-9e7a-c9f838f8b602', '0f2df4fe-eb7f-43d7-b30e-98a300f29d0f', 'cd0e6802-99cc-4f1d-9206-4f03a9a6cbe5'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:19:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:25 devstack sudo[93275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:19:25 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:26 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.445s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:19:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Deleted volume successfully.
Nov 05 04:19:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f95bd969-e86e-4c26-9c29-73472f78b2cb tempest-ServerActionsTestOtherA-1482894421 None] Lock "cinder-71fa90f6-6f32-4348-8194-3ea610979a9a-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:29 devstack sudo[93306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:19:29 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:29 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.523s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:19:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:19:35 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=30,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:19:36 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=26,cinder:UPDATE=36,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:19:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5c2495b6-44aa-485d-baa7-512ed81ec298 tempest-GroupsTest-1294545522 None] Group tempest-Group1-1471923452: creating
Nov 05 04:19:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5c2495b6-44aa-485d-baa7-512ed81ec298 tempest-GroupsTest-1294545522 None] Group tempest-Group1-1471923452: created successfully
Nov 05 04:19:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5c2495b6-44aa-485d-baa7-512ed81ec298 tempest-GroupsTest-1294545522 None] Create group completed successfully.
Nov 05 04:19:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-317c6535-dae5-467a-9e08-d0231b932cde tempest-GroupsTest-1294545522 None] Group tempest-Group2-1402451322: creating
Nov 05 04:19:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-317c6535-dae5-467a-9e08-d0231b932cde tempest-GroupsTest-1294545522 None] Group tempest-Group2-1402451322: created successfully
Nov 05 04:19:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-317c6535-dae5-467a-9e08-d0231b932cde tempest-GroupsTest-1294545522 None] Create group completed successfully.
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Flow 'volume_create_manager' (cba3a52a-0ef1-4935-ac02-57946a03ee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7961aef8-1500-4c52-8a90-73b6d183265b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7961aef8-1500-4c52-8a90-73b6d183265b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1418379127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d0ec7a7-fe30-4d9d-b023-a4539d9adfa5,host='devstack@QuobyteHD#QuobyteHD',id=d64eac0f-8893-4082-b133-1a2ffbe87f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684b1d40003443549ea78284620cb4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:45Z,use_quota=True,user_id='1551983094c341fda4c08d5d95392c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dec42f4b-f230-4d45-a8f6-509dcf34ac6b),volume_type_id=dec42f4b-f230-4d45-a8f6-509dcf34ac6b)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0e9bd2-a12a-428b-95c9-14b2ef05f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0e9bd2-a12a-428b-95c9-14b2ef05f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c01df84-4804-4810-b242-70963afb5cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c01df84-4804-4810-b242-70963afb5cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64eac0f-8893-4082-b133-1a2ffbe87f47', 'volume_name': 'volume-d64eac0f-8893-4082-b133-1a2ffbe87f47', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eee40e7-d84d-4b19-b99e-4f99a5a60502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eee40e7-d84d-4b19-b99e-4f99a5a60502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9ac209-8fed-4150-8934-e0a1d41db959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Volume d64eac0f-8893-4082-b133-1a2ffbe87f47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64eac0f-8893-4082-b133-1a2ffbe87f47', 'volume_size': 1}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0d0ec7a7-fe30-4d9d-b023-a4539d9adfa5,created_at=2026-11-05T03:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1418379127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0d0ec7a7-fe30-4d9d-b023-a4539d9adfa5,host='devstack@QuobyteHD#QuobyteHD',id=d64eac0f-8893-4082-b133-1a2ffbe87f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684b1d40003443549ea78284620cb4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:45Z,use_quota=True,user_id='1551983094c341fda4c08d5d95392c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dec42f4b-f230-4d45-a8f6-509dcf34ac6b),volume_type_id=dec42f4b-f230-4d45-a8f6-509dcf34ac6b)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Creating volume d64eac0f-8893-4082-b133-1a2ffbe87f47 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:19:45 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:45 devstack sudo[93369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47 1073741824
Nov 05 04:19:45 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:45 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47 1073741824" returned: 0 in 0.460s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:45 devstack sudo[93375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47
Nov 05 04:19:45 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:45 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab9ac209-8fed-4150-8934-e0a1d41db959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64eac0f-8893-4082-b133-1a2ffbe87f47', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219e0c11-4e87-48bb-b633-2f311255876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Volume volume-d64eac0f-8893-4082-b133-1a2ffbe87f47 (d64eac0f-8893-4082-b133-1a2ffbe87f47): created successfully
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219e0c11-4e87-48bb-b633-2f311255876a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Flow 'volume_create_manager' (cba3a52a-0ef1-4935-ac02-57946a03ee2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8775a6ec-947d-4d1e-ba59-41eb32658b75 tempest-GroupsTest-1294545522 None] Created volume successfully.
Nov 05 04:19:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Acquiring lock "cinder-quobyte-d64eac0f-8893-4082-b133-1a2ffbe87f47" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:19:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Lock "cinder-quobyte-d64eac0f-8893-4082-b133-1a2ffbe87f47" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:19:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1ef67d-579c-4754-8712-601075eb006c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:19:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:47 devstack sudo[93379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47
Nov 05 04:19:47 devstack sudo[93379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:47 devstack sudo[93379]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47" returned: 0 in 0.421s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:47 devstack sudo[93386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47
Nov 05 04:19:47 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:48 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d64eac0f-8893-4082-b133-1a2ffbe87f47" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Lock "cinder-quobyte-d64eac0f-8893-4082-b133-1a2ffbe87f47" released by "delete_volume" :: held 0.784s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Created reservations ['7a20b253-409c-4a48-8216-40718c918a66'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:19:48 devstack cinder-volume[87166]: WARNING cinder.quota [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-463613341 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-463613341, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:19:48 devstack cinder-volume[87166]: WARNING cinder.quota [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-463613341 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-463613341, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Created reservations ['f8710dc6-a2dc-4d85-817f-6f81527596d2', '34d25558-e361-4b62-9fad-83b00896f9ec', '9176b0cb-3df6-40f8-98e1-7159605162fc', '38e2955e-1cf9-4ef7-813d-d43f4344fb8d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:48 devstack sudo[93389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:19:48 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:48 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.311s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:19:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4ed3c239-b461-4d3f-acc8-f632a3df6eb2 tempest-GroupsTest-1294545522 None] Delete group completed successfully.
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] Created reservations ['b2e4a733-637b-489f-98e6-e4a573ca84c6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:48 devstack sudo[93393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:19:48 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:49 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:49 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:19:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cb51e8b6-e35a-4dae-88e5-b83a5fbbc2fc tempest-GroupsTest-1294545522 None] Delete group completed successfully.
Nov 05 04:19:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-814b55f3-e853-4166-8203-23ec7d978a2b tempest-GroupsTest-1294545522 None] Group tempest-GroupsTest-Group-494836063: creating
Nov 05 04:19:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-814b55f3-e853-4166-8203-23ec7d978a2b tempest-GroupsTest-1294545522 None] Group tempest-GroupsTest-Group-494836063: created successfully
Nov 05 04:19:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-814b55f3-e853-4166-8203-23ec7d978a2b tempest-GroupsTest-1294545522 None] Create group completed successfully.
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Flow 'volume_create_manager' (2b225ffc-5226-49e1-b5b2-eff6827a679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa95358-4401-4bcd-b7a7-9b070870f5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa95358-4401-4bcd-b7a7-9b070870f5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1975670234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=49d7d2ed-8dad-4cb9-83ea-2ae38fc05202,host='devstack@QuobyteHD#QuobyteHD',id=0c254e99-9549-49f3-ba98-e9ee43a382fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684b1d40003443549ea78284620cb4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:52Z,use_quota=True,user_id='1551983094c341fda4c08d5d95392c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a6f552-4041-4f29-aa7e-0c68c0ba5cfd),volume_type_id=d3a6f552-4041-4f29-aa7e-0c68c0ba5cfd)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73364ded-f945-42aa-9fa3-997730fd3daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73364ded-f945-42aa-9fa3-997730fd3daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482c3952-9816-4e6f-a8e3-0f1f25c55a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482c3952-9816-4e6f-a8e3-0f1f25c55a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c254e99-9549-49f3-ba98-e9ee43a382fe', 'volume_name': 'volume-0c254e99-9549-49f3-ba98-e9ee43a382fe', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11d47b5-538a-4cc5-a9ed-69f776cb03cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e11d47b5-538a-4cc5-a9ed-69f776cb03cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5525877d-7eb9-4e14-89a5-8f0ebc7363e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Volume 0c254e99-9549-49f3-ba98-e9ee43a382fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c254e99-9549-49f3-ba98-e9ee43a382fe', 'volume_size': 1}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=49d7d2ed-8dad-4cb9-83ea-2ae38fc05202,created_at=2026-11-05T03:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1975670234',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=49d7d2ed-8dad-4cb9-83ea-2ae38fc05202,host='devstack@QuobyteHD#QuobyteHD',id=0c254e99-9549-49f3-ba98-e9ee43a382fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684b1d40003443549ea78284620cb4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:52Z,use_quota=True,user_id='1551983094c341fda4c08d5d95392c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a6f552-4041-4f29-aa7e-0c68c0ba5cfd),volume_type_id=d3a6f552-4041-4f29-aa7e-0c68c0ba5cfd)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Creating volume 0c254e99-9549-49f3-ba98-e9ee43a382fe {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:19:52 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:52 devstack sudo[93398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe 1073741824
Nov 05 04:19:52 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:52 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe 1073741824" returned: 0 in 0.495s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:52 devstack sudo[93404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe
Nov 05 04:19:52 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:53 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:19:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5525877d-7eb9-4e14-89a5-8f0ebc7363e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c254e99-9549-49f3-ba98-e9ee43a382fe', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d74a76-4de0-4924-aba9-bda0b0c9da7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Volume volume-0c254e99-9549-49f3-ba98-e9ee43a382fe (0c254e99-9549-49f3-ba98-e9ee43a382fe): created successfully
Nov 05 04:19:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d74a76-4de0-4924-aba9-bda0b0c9da7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Flow 'volume_create_manager' (2b225ffc-5226-49e1-b5b2-eff6827a679f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-68724493-4fb2-4cd3-b942-adfdfad1c996 tempest-GroupsTest-1294545522 None] Created volume successfully.
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Flow 'volume_create_manager' (8d5cac27-f215-4c0a-bc7e-4738481c37e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b326e5ae-5ade-4e10-bf75-e7863ea0d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b326e5ae-5ade-4e10-bf75-e7863ea0d182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53128007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=49d7d2ed-8dad-4cb9-83ea-2ae38fc05202,host='devstack@QuobyteHD#QuobyteHD',id=181a1af3-bcd4-4147-bf74-43caf87d99a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684b1d40003443549ea78284620cb4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:54Z,use_quota=True,user_id='1551983094c341fda4c08d5d95392c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a6f552-4041-4f29-aa7e-0c68c0ba5cfd),volume_type_id=d3a6f552-4041-4f29-aa7e-0c68c0ba5cfd)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad89881-051b-4a33-8fae-cd841bb8947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad89881-051b-4a33-8fae-cd841bb8947c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbad2547-dd95-4d15-b336-57b554d93e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbad2547-dd95-4d15-b336-57b554d93e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '181a1af3-bcd4-4147-bf74-43caf87d99a7', 'volume_name': 'volume-181a1af3-bcd4-4147-bf74-43caf87d99a7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e2379a-27d8-4414-becd-ef13b377ec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e2379a-27d8-4414-becd-ef13b377ec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fae4601-6f4b-4508-b7b6-ca97834bbf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Volume 181a1af3-bcd4-4147-bf74-43caf87d99a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-181a1af3-bcd4-4147-bf74-43caf87d99a7', 'volume_size': 1}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=49d7d2ed-8dad-4cb9-83ea-2ae38fc05202,created_at=2026-11-05T03:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53128007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=49d7d2ed-8dad-4cb9-83ea-2ae38fc05202,host='devstack@QuobyteHD#QuobyteHD',id=181a1af3-bcd4-4147-bf74-43caf87d99a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='684b1d40003443549ea78284620cb4d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:19:54Z,use_quota=True,user_id='1551983094c341fda4c08d5d95392c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3a6f552-4041-4f29-aa7e-0c68c0ba5cfd),volume_type_id=d3a6f552-4041-4f29-aa7e-0c68c0ba5cfd)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Creating volume 181a1af3-bcd4-4147-bf74-43caf87d99a7 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:19:54 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:19:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:54 devstack sudo[93438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7 1073741824
Nov 05 04:19:54 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:55 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7 1073741824" returned: 0 in 0.730s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:19:55 devstack sudo[93461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7
Nov 05 04:19:55 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:19:55 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root
Nov 05 04:19:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7" returned: 0 in 0.421s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:19:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:19:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fae4601-6f4b-4508-b7b6-ca97834bbf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-181a1af3-bcd4-4147-bf74-43caf87d99a7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa78e8e4-166c-4beb-8870-3589f766914d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:19:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Volume volume-181a1af3-bcd4-4147-bf74-43caf87d99a7 (181a1af3-bcd4-4147-bf74-43caf87d99a7): created successfully
Nov 05 04:19:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa78e8e4-166c-4beb-8870-3589f766914d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:19:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Flow 'volume_create_manager' (8d5cac27-f215-4c0a-bc7e-4738481c37e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:19:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a234a770-a5d6-4c29-972c-966ead994024 tempest-GroupsTest-1294545522 None] Created volume successfully.
Nov 05 04:19:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-b84a6b46-0ef3-4a89-b294-c54ed77b15e9 req-c0ca65f5-ad81-437b-9392-b0f583530ba4 tempest-TaggedAttachmentsTest-769190986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:19:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-b84a6b46-0ef3-4a89-b294-c54ed77b15e9 req-c0ca65f5-ad81-437b-9392-b0f583530ba4 tempest-TaggedAttachmentsTest-769190986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:19:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-b84a6b46-0ef3-4a89-b294-c54ed77b15e9 req-c0ca65f5-ad81-437b-9392-b0f583530ba4 tempest-TaggedAttachmentsTest-769190986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:19:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-b84a6b46-0ef3-4a89-b294-c54ed77b15e9 req-c0ca65f5-ad81-437b-9392-b0f583530ba4 tempest-TaggedAttachmentsTest-769190986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '079b67d0-a5e2-4c40-9f48-c3b36232a0a3', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:19:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-b84a6b46-0ef3-4a89-b294-c54ed77b15e9 req-c0ca65f5-ad81-437b-9392-b0f583530ba4 tempest-TaggedAttachmentsTest-769190986 None] attachment_update completed successfully.
Nov 05 04:19:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f06f83e3-0370-4cac-97e7-a1c1f0f90d44 tempest-GroupsTest-1294545522 None] Update group completed successfully.
Nov 05 04:19:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ecf0d385-b6df-4788-a087-213a62544a0e tempest-GroupsTest-1294545522 None] Update group completed successfully.
Nov 05 04:20:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-a95d771d-5f05-437f-ba15-7fc8ef06be11 req-44aeba5f-c5c6-44b6-899d-5b5a5097866a tempest-TaggedAttachmentsTest-769190986 None] Terminate volume connection completed successfully.
Nov 05 04:20:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-a95d771d-5f05-437f-ba15-7fc8ef06be11 req-44aeba5f-c5c6-44b6-899d-5b5a5097866a tempest-TaggedAttachmentsTest-769190986 None] Deleting attachment 079b67d0-a5e2-4c40-9f48-c3b36232a0a3. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:20:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Acquiring lock "cinder-quobyte-0c254e99-9549-49f3-ba98-e9ee43a382fe" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Lock "cinder-quobyte-0c254e99-9549-49f3-ba98-e9ee43a382fe" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1552239b-4770-40ac-b78e-37e3587b6034]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:01 devstack sudo[93967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe
Nov 05 04:20:01 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:01 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe" returned: 0 in 0.510s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:01 devstack sudo[93977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe
Nov 05 04:20:01 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:01 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0c254e99-9549-49f3-ba98-e9ee43a382fe" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Lock "cinder-quobyte-0c254e99-9549-49f3-ba98-e9ee43a382fe" released by "delete_volume" :: held 0.953s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Acquiring lock "cinder-quobyte-181a1af3-bcd4-4147-bf74-43caf87d99a7" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Lock "cinder-quobyte-181a1af3-bcd4-4147-bf74-43caf87d99a7" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb779a9-e67d-4e59-a493-4477ade66eab]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:02 devstack sudo[93982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7
Nov 05 04:20:02 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7" returned: 0 in 0.754s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:02 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:02 devstack sudo[94011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7
Nov 05 04:20:02 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:03 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-181a1af3-bcd4-4147-bf74-43caf87d99a7" returned: 0 in 0.571s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Lock "cinder-quobyte-181a1af3-bcd4-4147-bf74-43caf87d99a7" released by "delete_volume" :: held 1.396s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Created reservations ['47073ea1-17f0-486b-82ff-85aa0a22f206'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:03 devstack cinder-volume[87166]: WARNING cinder.quota [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1667187518 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1667187518, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:20:03 devstack cinder-volume[87166]: WARNING cinder.quota [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1667187518 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1667187518, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:20:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Created reservations ['c443af41-ae63-4d2f-b281-254eeef6f8e2', 'a9d7c7b1-6b15-49a5-9a05-3965ea048842', 'b7f02130-6578-4019-a19f-98b8529688b5', '9b1502f9-b48b-4ea2-8f49-c098cb61f02c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Created reservations ['ba87996c-869f-4c57-a837-bb7053a2c7a4', 'd9032b8c-569d-4ab1-b823-4030b22c7226', '24f8625d-459c-497b-9ea6-48dff68102c5', 'e0cf0ce9-2fb1-4486-9355-06ca4a77c885'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:04 devstack sudo[94071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:04 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:04 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.467s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:04 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d725cf21-6360-415f-9778-c79cfb3b304b tempest-GroupsTest-1294545522 None] Delete group completed successfully.
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (fde1cd61-7f8b-4625-a70e-92d2b3db7e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8d9580-81d8-44c9-acc3-438071bcad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8d9580-81d8-44c9-acc3-438071bcad40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-321347088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4207337f-c6d9-4aa8-9d8f-ea29f915a924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:10Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05cab619-2b80-4f05-8a78-c80fc584ca88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05cab619-2b80-4f05-8a78-c80fc584ca88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d85c09-1e43-4272-9f56-302223041d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d85c09-1e43-4272-9f56-302223041d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4207337f-c6d9-4aa8-9d8f-ea29f915a924', 'volume_name': 'volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727aba04-ac40-4f96-ad57-73d0f24099dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727aba04-ac40-4f96-ad57-73d0f24099dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621c63d0-2c2b-46a5-a570-cbd7bd4677f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Volume 4207337f-c6d9-4aa8-9d8f-ea29f915a924: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924', 'volume_size': 1}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-321347088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4207337f-c6d9-4aa8-9d8f-ea29f915a924,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:10Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Creating volume 4207337f-c6d9-4aa8-9d8f-ea29f915a924 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:10 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:10 devstack sudo[94166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924 1073741824
Nov 05 04:20:10 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:11 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924 1073741824" returned: 0 in 0.855s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:11 devstack sudo[94173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924
Nov 05 04:20:11 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:12 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924" returned: 0 in 0.413s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621c63d0-2c2b-46a5-a570-cbd7bd4677f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548c498d-3eae-49e6-b371-6e55391b3b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Volume volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924 (4207337f-c6d9-4aa8-9d8f-ea29f915a924): created successfully
Nov 05 04:20:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (548c498d-3eae-49e6-b371-6e55391b3b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (fde1cd61-7f8b-4625-a70e-92d2b3db7e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d7cf19f4-ae32-4dd0-ac1b-e4246e16b6e0 tempest-VolumesActionsTest-2128665533 None] Created volume successfully.
Nov 05 04:20:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a74609a6-0a92-461d-bd57-b4e076ed2701 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924" by "attach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a74609a6-0a92-461d-bd57-b4e076ed2701 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924" acquired by "attach_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a74609a6-0a92-461d-bd57-b4e076ed2701 tempest-VolumesActionsTest-2128665533 None] Attaching volume 4207337f-c6d9-4aa8-9d8f-ea29f915a924 to instance 644539f8-ba0b-4748-9b8e-d7215938fa28 at mountpoint /dev/vdb on host None.
Nov 05 04:20:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a74609a6-0a92-461d-bd57-b4e076ed2701 tempest-VolumesActionsTest-2128665533 None] Attach volume completed successfully.
Nov 05 04:20:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a74609a6-0a92-461d-bd57-b4e076ed2701 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924" released by "attach_volume" :: held 0.244s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-80aaac95-1545-4890-959b-e5d0973c7f3a tempest-VolumesActionsTest-1584407078 None] Terminate volume connection completed successfully.
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80aaac95-1545-4890-959b-e5d0973c7f3a tempest-VolumesActionsTest-1584407078 None] Acquiring lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924-detach_volume" by "detach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80aaac95-1545-4890-959b-e5d0973c7f3a tempest-VolumesActionsTest-1584407078 None] Lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-80aaac95-1545-4890-959b-e5d0973c7f3a tempest-VolumesActionsTest-1584407078 None] Detaching volume 4207337f-c6d9-4aa8-9d8f-ea29f915a924 from instance 644539f8-ba0b-4748-9b8e-d7215938fa28.
Nov 05 04:20:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-80aaac95-1545-4890-959b-e5d0973c7f3a tempest-VolumesActionsTest-1584407078 None] Detach volume completed successfully.
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-80aaac95-1545-4890-959b-e5d0973c7f3a tempest-VolumesActionsTest-1584407078 None] Lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-348e9ffc-48c1-424e-b25f-cebd336fc0f3 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924-detach_volume" by "detach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-348e9ffc-48c1-424e-b25f-cebd336fc0f3 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-348e9ffc-48c1-424e-b25f-cebd336fc0f3 tempest-VolumesActionsTest-2128665533 None] Volume detach called, but volume not attached.
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-348e9ffc-48c1-424e-b25f-cebd336fc0f3 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "cinder-quobyte-4207337f-c6d9-4aa8-9d8f-ea29f915a924" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-quobyte-4207337f-c6d9-4aa8-9d8f-ea29f915a924" acquired by "delete_volume" :: waited 0.050s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38eb82d-0fec-416c-91af-0f8e562fdcb5]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:16 devstack sudo[94180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924
Nov 05 04:20:16 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:16 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924" returned: 0 in 0.666s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:16 devstack sudo[94193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924
Nov 05 04:20:16 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:17 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4207337f-c6d9-4aa8-9d8f-ea29f915a924" returned: 0 in 0.468s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-quobyte-4207337f-c6d9-4aa8-9d8f-ea29f915a924" released by "delete_volume" :: held 1.276s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:17 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Created reservations ['acd169d7-09db-4fb3-975c-902cfbf22b8f', '1dd6570a-281d-4fb2-9442-b8e841d8d4a9', '113109f6-6382-46f6-b0ae-aa3c3ac66da8', '63eb3679-6494-4e80-9bf6-417c877e15a0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:17 devstack sudo[94202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:17 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:18 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.532s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:18 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Deleted volume successfully.
Nov 05 04:20:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a3667f6-fdfe-4a6c-977b-e43f21cc4958 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-4207337f-c6d9-4aa8-9d8f-ea29f915a924-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Acquiring lock "cinder-539e5d22-fa40-40e9-b4e1-fea7c436c5b3-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Lock "cinder-539e5d22-fa40-40e9-b4e1-fea7c436c5b3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Acquiring lock "cinder-quobyte-539e5d22-fa40-40e9-b4e1-fea7c436c5b3" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Lock "cinder-quobyte-539e5d22-fa40-40e9-b4e1-fea7c436c5b3" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[21335871-6524-4ef9-ad81-f62b678fd303]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:19 devstack sudo[94213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3
Nov 05 04:20:19 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:19 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3" returned: 0 in 0.773s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:19 devstack sudo[94237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3
Nov 05 04:20:19 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:20 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539e5d22-fa40-40e9-b4e1-fea7c436c5b3" returned: 0 in 0.431s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Lock "cinder-quobyte-539e5d22-fa40-40e9-b4e1-fea7c436c5b3" released by "delete_volume" :: held 1.290s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Created reservations ['5c327503-735c-48e9-83b4-1e4f6369a248', '77860a7e-dfdf-46f4-b3c7-ef9921a1044d', '34160bc0-6ee1-4963-af46-3268972bf34e', '8ba968fb-56e0-4e0e-bf61-189cb472ce35'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:20 devstack sudo[94245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:20 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:20 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.340s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Deleted volume successfully.
Nov 05 04:20:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0f83d77a-6b62-4bcd-a278-1d1ae8213aed tempest-TaggedAttachmentsTest-769190986 None] Lock "cinder-539e5d22-fa40-40e9-b4e1-fea7c436c5b3-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (ef75d136-30d3-47f2-9633-3cdd7943b8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fbec96-8475-4de5-8fd7-a2e928abb851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fbec96-8475-4de5-8fd7-a2e928abb851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1491950266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbfe816-b425-41aa-a9a7-e9e44d217413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:23Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52624e9c-8795-42ac-a4c6-1e75129da093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52624e9c-8795-42ac-a4c6-1e75129da093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a70314-9738-4d41-899c-0a48866f8ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a70314-9738-4d41-899c-0a48866f8ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbfe816-b425-41aa-a9a7-e9e44d217413', 'volume_name': 'volume-afbfe816-b425-41aa-a9a7-e9e44d217413', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce977632-a20e-4277-b567-64c8f8407316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce977632-a20e-4277-b567-64c8f8407316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efc2a98-de01-4e94-846b-a43f3453ae05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Volume afbfe816-b425-41aa-a9a7-e9e44d217413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbfe816-b425-41aa-a9a7-e9e44d217413', 'volume_size': 1}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1491950266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbfe816-b425-41aa-a9a7-e9e44d217413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:23Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Creating volume afbfe816-b425-41aa-a9a7-e9e44d217413 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:22 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:23 devstack sudo[94274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413 1073741824
Nov 05 04:20:23 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:23 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413 1073741824" returned: 0 in 0.507s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:23 devstack sudo[94279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413
Nov 05 04:20:23 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:23 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efc2a98-de01-4e94-846b-a43f3453ae05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbfe816-b425-41aa-a9a7-e9e44d217413', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56115848-f11b-424e-9983-d19e8ff240c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Volume volume-afbfe816-b425-41aa-a9a7-e9e44d217413 (afbfe816-b425-41aa-a9a7-e9e44d217413): created successfully
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56115848-f11b-424e-9983-d19e8ff240c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (ef75d136-30d3-47f2-9633-3cdd7943b8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d9c525dc-3dcb-4729-8f51-7b82e9d40691 tempest-VolumesActionsTest-2128665533 None] Created volume successfully.
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Acquiring lock "cinder-afbfe816-b425-41aa-a9a7-e9e44d217413-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Lock "cinder-afbfe816-b425-41aa-a9a7-e9e44d217413-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Acquiring lock "cinder-quobyte-afbfe816-b425-41aa-a9a7-e9e44d217413" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Lock "cinder-quobyte-afbfe816-b425-41aa-a9a7-e9e44d217413" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e11745-fee0-4b26-8a73-5406a2dbf7ee]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:25 devstack sudo[94318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413
Nov 05 04:20:25 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:25 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413" returned: 0 in 0.400s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:25 devstack sudo[94323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413
Nov 05 04:20:25 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afbfe816-b425-41aa-a9a7-e9e44d217413" returned: 0 in 0.294s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:25 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Lock "cinder-quobyte-afbfe816-b425-41aa-a9a7-e9e44d217413" released by "delete_volume" :: held 0.747s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Created reservations ['5c57d6f8-2fe6-4a08-bc6c-1cf38a9f4318', '1430f6f7-2f06-4d5c-b7a5-54a126c8d8f1', 'f0137cf4-c605-4aaa-b65e-d64adbfad145', 'a6de1830-2887-42e5-8afd-415d4f511b4b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:26 devstack sudo[94327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:26 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:26 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.275s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Deleted volume successfully.
Nov 05 04:20:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c31e989-7759-4a6a-b4ea-ed3d87bd294f tempest-VolumesActionsTest-1584407078 None] Lock "cinder-afbfe816-b425-41aa-a9a7-e9e44d217413-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (a6063870-fdd7-4944-85de-beb5bdf8b875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37e8d1b-ff06-4614-bfd1-554a9607c9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37e8d1b-ff06-4614-bfd1-554a9607c9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-148665716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946c247a-dc0e-4924-a2c8-8e886e847c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:27Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e4765e-97d0-4642-8beb-bb59671473c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e4765e-97d0-4642-8beb-bb59671473c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8f47db-3c8e-457a-82a4-9661252e2474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8f47db-3c8e-457a-82a4-9661252e2474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '946c247a-dc0e-4924-a2c8-8e886e847c4c', 'volume_name': 'volume-946c247a-dc0e-4924-a2c8-8e886e847c4c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de4f831-02a0-47e1-bfb8-77c09744fde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de4f831-02a0-47e1-bfb8-77c09744fde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5811ce-5ae4-4b39-9897-3746fe81076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Volume 946c247a-dc0e-4924-a2c8-8e886e847c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-946c247a-dc0e-4924-a2c8-8e886e847c4c', 'volume_size': 1}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-148665716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=946c247a-dc0e-4924-a2c8-8e886e847c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:27Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Creating volume 946c247a-dc0e-4924-a2c8-8e886e847c4c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:27 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:27 devstack sudo[94330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c 1073741824
Nov 05 04:20:27 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:27 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c 1073741824" returned: 0 in 0.556s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:27 devstack sudo[94337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c
Nov 05 04:20:27 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:28 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c" returned: 0 in 0.292s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5811ce-5ae4-4b39-9897-3746fe81076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-946c247a-dc0e-4924-a2c8-8e886e847c4c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6864502-f2be-438e-9bfc-b7481f41fc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Volume volume-946c247a-dc0e-4924-a2c8-8e886e847c4c (946c247a-dc0e-4924-a2c8-8e886e847c4c): created successfully
Nov 05 04:20:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6864502-f2be-438e-9bfc-b7481f41fc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (a6063870-fdd7-4944-85de-beb5bdf8b875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-260b09b4-6c37-495c-aa5b-e97b70a8c480 tempest-VolumesActionsTest-2128665533 None] Created volume successfully.
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:29 devstack sudo[94341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:29 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Acquiring lock "cinder-946c247a-dc0e-4924-a2c8-8e886e847c4c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Lock "cinder-946c247a-dc0e-4924-a2c8-8e886e847c4c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Acquiring lock "cinder-quobyte-946c247a-dc0e-4924-a2c8-8e886e847c4c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Lock "cinder-quobyte-946c247a-dc0e-4924-a2c8-8e886e847c4c" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1912184-f3c9-4dad-b685-85df9fe8ff38]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:29 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:20:29 devstack sudo[94344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c
Nov 05 04:20:29 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:29 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c" returned: 0 in 0.556s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:30 devstack sudo[94349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c
Nov 05 04:20:30 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:30 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-946c247a-dc0e-4924-a2c8-8e886e847c4c" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Lock "cinder-quobyte-946c247a-dc0e-4924-a2c8-8e886e847c4c" released by "delete_volume" :: held 1.060s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Created reservations ['53fecb6d-d744-4272-b526-3e69c1daeb5a', '0504b1de-ce29-41d0-9e97-fce711e04156', 'cfa0baf3-dfa7-4f5f-b8c0-92c232f073b1', '994f2e30-297d-4f5e-8635-ed5de561f98f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:30 devstack sudo[94353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:30 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:30 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:30 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Deleted volume successfully.
Nov 05 04:20:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84c6d7c-baf9-4222-815f-68d2d1b57dd2 tempest-VolumesActionsTest-1584407078 None] Lock "cinder-946c247a-dc0e-4924-a2c8-8e886e847c4c-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (98ea8a7c-dae1-426e-8173-917e9deb8042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32639d61-9932-4eac-bc4d-cc6cf88a88c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32639d61-9932-4eac-bc4d-cc6cf88a88c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367927946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0f6a97-69a8-47ce-873d-954f1a96edcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:32Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89aae03-05df-43ea-94fa-3857bfe8621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89aae03-05df-43ea-94fa-3857bfe8621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755cb42d-388a-4fa7-b06b-6940b104f82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755cb42d-388a-4fa7-b06b-6940b104f82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0f6a97-69a8-47ce-873d-954f1a96edcb', 'volume_name': 'volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cf3208-721c-4657-910b-8e16abfee00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80cf3208-721c-4657-910b-8e16abfee00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7900ae13-82dc-4c99-a19b-8b88ae6650a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:32 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Volume cf0f6a97-69a8-47ce-873d-954f1a96edcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb', 'volume_size': 1}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-367927946',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0f6a97-69a8-47ce-873d-954f1a96edcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:32Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Creating volume cf0f6a97-69a8-47ce-873d-954f1a96edcb {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:32 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:32 devstack sudo[94357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb 1073741824
Nov 05 04:20:32 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:32 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb 1073741824" returned: 0 in 0.523s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:33 devstack sudo[94363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb
Nov 05 04:20:33 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:33 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7900ae13-82dc-4c99-a19b-8b88ae6650a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab1c4e5-d5a2-48c5-b6eb-2a83c994392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Volume volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb (cf0f6a97-69a8-47ce-873d-954f1a96edcb): created successfully
Nov 05 04:20:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ab1c4e5-d5a2-48c5-b6eb-2a83c994392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (98ea8a7c-dae1-426e-8173-917e9deb8042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-77c0865f-fabd-412a-a633-74a5bc578714 tempest-VolumesActionsTest-2128665533 None] Created volume successfully.
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Flow 'volume_create_manager' (dd1fae28-5bf1-47b9-9307-5d4639eebb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da723c1-b3ce-473f-bc4a-f89324d80b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da723c1-b3ce-473f-bc4a-f89324d80b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1003559751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2f11c3-b9ea-43e3-9e24-e61e03eb572e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1b61260c34ded95bd80c804791885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:34Z,use_quota=True,user_id='d186ccf0ebcb404ca64a79a941d5519c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef27a07-392e-4866-8131-d3875a111f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef27a07-392e-4866-8131-d3875a111f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42c4db3-41c8-4fd3-a909-3e01bb81f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42c4db3-41c8-4fd3-a909-3e01bb81f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad2f11c3-b9ea-43e3-9e24-e61e03eb572e', 'volume_name': 'volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee07b8f-a266-430a-8cac-16a673a7be91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee07b8f-a266-430a-8cac-16a673a7be91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac1fc95-2e50-4341-87fc-e4ca052e806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Volume ad2f11c3-b9ea-43e3-9e24-e61e03eb572e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e', 'volume_size': 1}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1003559751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad2f11c3-b9ea-43e3-9e24-e61e03eb572e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1b61260c34ded95bd80c804791885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:34Z,use_quota=True,user_id='d186ccf0ebcb404ca64a79a941d5519c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Creating volume ad2f11c3-b9ea-43e3-9e24-e61e03eb572e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:34 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:34 devstack sudo[94368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e 1073741824
Nov 05 04:20:34 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Acquiring lock "cinder-cf0f6a97-69a8-47ce-873d-954f1a96edcb-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Lock "cinder-cf0f6a97-69a8-47ce-873d-954f1a96edcb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Acquiring lock "cinder-quobyte-cf0f6a97-69a8-47ce-873d-954f1a96edcb" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Lock "cinder-quobyte-cf0f6a97-69a8-47ce-873d-954f1a96edcb" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf5e4ee-40e1-4f1e-a7ad-c506e91d5b5d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:34 devstack sudo[94373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb
Nov 05 04:20:34 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:34 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e 1073741824" returned: 0 in 0.579s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:35 devstack sudo[94376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e
Nov 05 04:20:35 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:35 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb" returned: 0 in 0.541s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:35 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:35 devstack sudo[94382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb
Nov 05 04:20:35 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac1fc95-2e50-4341-87fc-e4ca052e806b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06dbbdd-8831-46db-8dc3-fc19053512ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Flow 'volume_create_manager' (2e31c6c2-965b-424c-b06e-cf13c5f8bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db2172a-bb2b-45c7-a9e8-f2de072fd443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:35 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Volume volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e (ad2f11c3-b9ea-43e3-9e24-e61e03eb572e): created successfully
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06dbbdd-8831-46db-8dc3-fc19053512ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Flow 'volume_create_manager' (dd1fae28-5bf1-47b9-9307-5d4639eebb38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db2172a-bb2b-45c7-a9e8-f2de072fd443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1746077208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6743b718-bec1-4277-9acd-0aa55201c188,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b009dc2071d94b92ad80b03530890797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:35Z,use_quota=True,user_id='b700bfd54b564d35809738af40c11a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad0743e-dfed-4219-a0fb-63a4c3860dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad0743e-dfed-4219-a0fb-63a4c3860dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a007ff10-cc6a-4052-805d-479f881cb581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a007ff10-cc6a-4052-805d-479f881cb581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6743b718-bec1-4277-9acd-0aa55201c188', 'volume_name': 'volume-6743b718-bec1-4277-9acd-0aa55201c188', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3277ea-36aa-4432-b907-6ddfa0f29031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3277ea-36aa-4432-b907-6ddfa0f29031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b91921-a78b-441a-9e6e-985ff5d63312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:35 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Volume 6743b718-bec1-4277-9acd-0aa55201c188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6743b718-bec1-4277-9acd-0aa55201c188', 'volume_size': 1}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1746077208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6743b718-bec1-4277-9acd-0aa55201c188,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b009dc2071d94b92ad80b03530890797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:35Z,use_quota=True,user_id='b700bfd54b564d35809738af40c11a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Creating volume 6743b718-bec1-4277-9acd-0aa55201c188 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:35 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ae4dd804-b867-452d-874a-3e4a851a7fbb tempest-AttachVolumeTestJSON-1529889698 None] Created volume successfully.
Nov 05 04:20:35 devstack sudo[94384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188 1073741824
Nov 05 04:20:35 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:35 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf0f6a97-69a8-47ce-873d-954f1a96edcb" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Lock "cinder-quobyte-cf0f6a97-69a8-47ce-873d-954f1a96edcb" released by "delete_volume" :: held 0.897s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=94,cinder:UPDATE=101,cinder:INSERT=18,cinder:DELETE=4 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Created reservations ['0b2a99b1-91b9-43e3-a3b2-8c57d96aae94', 'b83e0663-6194-4c23-a00e-24251ee53b68', '384d6b85-7a6e-408a-a8fe-9919cc95be32', '178c6a1e-f082-4356-80b8-177208260bf9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:35 devstack sudo[94389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:35 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:36 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188 1073741824" returned: 0 in 0.503s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:36 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Deleted volume successfully.
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3734584a-b6c9-4a4f-be0b-da2be945aafc tempest-VolumesActionsTest-1584407078 None] Lock "cinder-cf0f6a97-69a8-47ce-873d-954f1a96edcb-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:36 devstack sudo[94394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188
Nov 05 04:20:36 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:36 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b91921-a78b-441a-9e6e-985ff5d63312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6743b718-bec1-4277-9acd-0aa55201c188', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e08014-ff06-4ed6-87e4-012f8106b90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=90,cinder:UPDATE=108,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:20:36 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Volume volume-6743b718-bec1-4277-9acd-0aa55201c188 (6743b718-bec1-4277-9acd-0aa55201c188): created successfully
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e08014-ff06-4ed6-87e4-012f8106b90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Flow 'volume_create_manager' (2e31c6c2-965b-424c-b06e-cf13c5f8bb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-ab919534-cd3c-4e3a-b8dd-b8a9d062bfb0 req-202369fb-e4a4-49b6-961c-554be423834a tempest-VolumesGetTestJSON-1803010048 None] Created volume successfully.
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Acquiring lock "cinder-6743b718-bec1-4277-9acd-0aa55201c188-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Lock "cinder-6743b718-bec1-4277-9acd-0aa55201c188-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Acquiring lock "cinder-quobyte-6743b718-bec1-4277-9acd-0aa55201c188" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Lock "cinder-quobyte-6743b718-bec1-4277-9acd-0aa55201c188" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b2e2ac-f0ef-4c05-941a-52f5abcd68bf]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-e21c1434-1da6-4b46-8d80-53daba572c95 req-e3b0857c-9306-47d8-8c17-fcff22d4eb42 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-e21c1434-1da6-4b46-8d80-53daba572c95 req-e3b0857c-9306-47d8-8c17-fcff22d4eb42 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-e21c1434-1da6-4b46-8d80-53daba572c95 req-e3b0857c-9306-47d8-8c17-fcff22d4eb42 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-e21c1434-1da6-4b46-8d80-53daba572c95 req-e3b0857c-9306-47d8-8c17-fcff22d4eb42 tempest-AttachVolumeTestJSON-1529889698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '094aa49e-cc81-4834-8197-d4c6c77267a3', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:20:37 devstack sudo[94410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188
Nov 05 04:20:37 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-e21c1434-1da6-4b46-8d80-53daba572c95 req-e3b0857c-9306-47d8-8c17-fcff22d4eb42 tempest-AttachVolumeTestJSON-1529889698 None] attachment_update completed successfully.
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (97f391a0-8f90-4be8-9b72-f78bebee9500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27208115-58d8-4593-b22a-3cdfff430acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27208115-58d8-4593-b22a-3cdfff430acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-221936000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74c9226-cc0a-4785-982b-c126bf8a166f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:38Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a36b4c8-6218-47e5-a369-5f1b9c067000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a36b4c8-6218-47e5-a369-5f1b9c067000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3beaab-0a27-4adc-af32-4a6f585043c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3beaab-0a27-4adc-af32-4a6f585043c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74c9226-cc0a-4785-982b-c126bf8a166f', 'volume_name': 'volume-e74c9226-cc0a-4785-982b-c126bf8a166f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55c5136-ce37-48ee-b27f-2f42fd90619d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55c5136-ce37-48ee-b27f-2f42fd90619d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb461ce-47ba-4e2a-a946-b55c97c737a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Volume e74c9226-cc0a-4785-982b-c126bf8a166f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74c9226-cc0a-4785-982b-c126bf8a166f', 'volume_size': 1}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-221936000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74c9226-cc0a-4785-982b-c126bf8a166f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:38Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Creating volume e74c9226-cc0a-4785-982b-c126bf8a166f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:37 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:37 devstack sudo[94440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f 1073741824
Nov 05 04:20:37 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:37 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188" returned: 0 in 0.508s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:37 devstack sudo[94497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188
Nov 05 04:20:37 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:38 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6743b718-bec1-4277-9acd-0aa55201c188" returned: 0 in 0.337s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Lock "cinder-quobyte-6743b718-bec1-4277-9acd-0aa55201c188" released by "delete_volume" :: held 0.904s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.quota [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Created reservations ['d257cf9a-ffac-4600-9ce9-2fb97ed45639', '779cff54-6491-4997-a2f2-e4b64df9d4b3', '51e48f2a-be59-42c8-8581-cd1f2b7810b9', 'f7f8cfdd-63f5-4b4a-ab70-99be07291715'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:38 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f 1073741824" returned: 0 in 0.658s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:38 devstack sudo[94841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:38 devstack sudo[94841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:38 devstack sudo[94843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f
Nov 05 04:20:38 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Flow 'volume_create_manager' (c3ca24d8-dffb-4540-b172-634bc9611d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bdbf0a-e1bd-410b-83b1-d948c1051638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90bdbf0a-e1bd-410b-83b1-d948c1051638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2056349257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f1453b-706d-4880-92ff-47b1295b3551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f454935828f74f78a0171cc4e2429991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:39Z,use_quota=True,user_id='5dd7d8410668400a85dcf60047790579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfb6993-9fec-4a30-bc09-331c8b7a7ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfb6993-9fec-4a30-bc09-331c8b7a7ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:38 devstack sudo[94841]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0f16b3-cd3e-430c-b2c6-f2b252643c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d0f16b3-cd3e-430c-b2c6-f2b252643c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f1453b-706d-4880-92ff-47b1295b3551', 'volume_name': 'volume-96f1453b-706d-4880-92ff-47b1295b3551', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950cbeb3-3ecc-4211-9b15-c0c8519f124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950cbeb3-3ecc-4211-9b15-c0c8519f124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119d6076-70b2-4de1-bbc1-ed1658b54b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Volume 96f1453b-706d-4880-92ff-47b1295b3551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f1453b-706d-4880-92ff-47b1295b3551', 'volume_size': 1}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.413s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.manager [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Deleted volume successfully.
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-804aa515-a94f-4057-8410-8adf9c1735fc req-2912a5aa-4d8e-41cb-a2ec-a88578d2359c tempest-VolumesGetTestJSON-1803010048 None] Lock "cinder-6743b718-bec1-4277-9acd-0aa55201c188-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:38 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.075s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2056349257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f1453b-706d-4880-92ff-47b1295b3551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f454935828f74f78a0171cc4e2429991',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:39Z,use_quota=True,user_id='5dd7d8410668400a85dcf60047790579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Creating volume 96f1453b-706d-4880-92ff-47b1295b3551 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:38 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb461ce-47ba-4e2a-a946-b55c97c737a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74c9226-cc0a-4785-982b-c126bf8a166f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:38 devstack sudo[94847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551 1073741824
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1827be-29c5-45bd-bb1d-c85473716145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:38 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Volume volume-e74c9226-cc0a-4785-982b-c126bf8a166f (e74c9226-cc0a-4785-982b-c126bf8a166f): created successfully
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1827be-29c5-45bd-bb1d-c85473716145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (97f391a0-8f90-4be8-9b72-f78bebee9500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-60b06697-998c-490e-a10d-f7f8ec3d25bb tempest-VolumesActionsTest-2128665533 None] Created volume successfully.
Nov 05 04:20:39 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551 1073741824" returned: 0 in 0.527s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:39 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551
Nov 05 04:20:39 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:39 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (119d6076-70b2-4de1-bbc1-ed1658b54b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f1453b-706d-4880-92ff-47b1295b3551', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4895ade-557a-4a86-8cc9-8a8cd3e24d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Volume volume-96f1453b-706d-4880-92ff-47b1295b3551 (96f1453b-706d-4880-92ff-47b1295b3551): created successfully
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4895ade-557a-4a86-8cc9-8a8cd3e24d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Flow 'volume_create_manager' (c3ca24d8-dffb-4540-b172-634bc9611d2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dfbac340-9d0e-4870-a386-5a3390845f4d tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Created volume successfully.
Nov 05 04:20:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Acquiring lock "cinder-e74c9226-cc0a-4785-982b-c126bf8a166f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Lock "cinder-e74c9226-cc0a-4785-982b-c126bf8a166f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Flow 'volume_create_manager' (0c17e2fc-4986-42fc-b157-90ce117cef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78423fe6-13c4-4f24-a2a1-66f1f351745e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78423fe6-13c4-4f24-a2a1-66f1f351745e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-349347655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70001d77-cbb9-4100-9fa8-13b3ecfacfc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1b61260c34ded95bd80c804791885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:40Z,use_quota=True,user_id='d186ccf0ebcb404ca64a79a941d5519c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d99d4e8-581e-4b9e-a257-5b0dcf26e3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d99d4e8-581e-4b9e-a257-5b0dcf26e3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e387704-fb90-470c-9dc2-15e86af36082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e387704-fb90-470c-9dc2-15e86af36082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70001d77-cbb9-4100-9fa8-13b3ecfacfc7', 'volume_name': 'volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86312a7-ea0f-4cdd-8232-8d921636a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86312a7-ea0f-4cdd-8232-8d921636a682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b98033-c3ed-4bca-a804-6b4b81b3c069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:40 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Volume 70001d77-cbb9-4100-9fa8-13b3ecfacfc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7', 'volume_size': 1}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-349347655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70001d77-cbb9-4100-9fa8-13b3ecfacfc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f1b61260c34ded95bd80c804791885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:40Z,use_quota=True,user_id='d186ccf0ebcb404ca64a79a941d5519c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Creating volume 70001d77-cbb9-4100-9fa8-13b3ecfacfc7 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:40 devstack sudo[94857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7 1073741824
Nov 05 04:20:40 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Acquiring lock "cinder-quobyte-e74c9226-cc0a-4785-982b-c126bf8a166f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Lock "cinder-quobyte-e74c9226-cc0a-4785-982b-c126bf8a166f" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1fc5a6-ac69-4261-b78b-e871d5aa9c3e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:40 devstack sudo[94859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f
Nov 05 04:20:40 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:40 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:40 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7 1073741824" returned: 0 in 0.507s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:40 devstack sudo[94868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f
Nov 05 04:20:40 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:40 devstack sudo[94870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7
Nov 05 04:20:40 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:40 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e74c9226-cc0a-4785-982b-c126bf8a166f" returned: 0 in 0.294s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Lock "cinder-quobyte-e74c9226-cc0a-4785-982b-c126bf8a166f" released by "delete_volume" :: held 0.774s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:40 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b98033-c3ed-4bca-a804-6b4b81b3c069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88af69f-062a-4c36-aa36-bca819f6f691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Volume volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7 (70001d77-cbb9-4100-9fa8-13b3ecfacfc7): created successfully
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a88af69f-062a-4c36-aa36-bca819f6f691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Flow 'volume_create_manager' (0c17e2fc-4986-42fc-b157-90ce117cef4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0c8b417f-176a-4ae4-8600-35dfed7bdd93 tempest-AttachVolumeTestJSON-1529889698 None] Created volume successfully.
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Created reservations ['bf214fbc-3f04-40a7-aeb7-1eba9765a967', 'b8cda6bd-0f86-409c-8906-9afb28499343', '267e9014-28cc-43f3-82b2-3cac3e16bcb1', '5538aeb6-95da-46d2-af1e-77b5565e5254'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:41 devstack sudo[94874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:41 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:41 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.273s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Deleted volume successfully.
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc4ee199-1d39-40db-bfd6-abe5b7bb3385 tempest-VolumesActionsTest-1584407078 None] Lock "cinder-e74c9226-cc0a-4785-982b-c126bf8a166f-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (5b99357a-81fe-422b-8cbc-12f296f4a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d12ea0d-9543-4ec7-b907-76cf30bca79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d12ea0d-9543-4ec7-b907-76cf30bca79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815906980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:42Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b94712c-e1bb-42c5-91ee-5713978de689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b94712c-e1bb-42c5-91ee-5713978de689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda41d52-550d-4dd3-9d0e-1be4ffe42fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cda41d52-550d-4dd3-9d0e-1be4ffe42fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0', 'volume_name': 'volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb0ea82-33cd-47a7-b177-876a74e7bafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb0ea82-33cd-47a7-b177-876a74e7bafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab5e35b-7fda-45f8-be95-d3067ce9473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Volume b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0', 'volume_size': 1}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-815906980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5527923a000d4bb1a2d684055615ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:42Z,use_quota=True,user_id='73549651876b482fa74f641e478e1286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Creating volume b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:41 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:41 devstack sudo[94877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0 1073741824
Nov 05 04:20:41 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:42 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0 1073741824" returned: 0 in 0.535s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Acquiring lock "cinder-96f1453b-706d-4880-92ff-47b1295b3551-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "cinder-96f1453b-706d-4880-92ff-47b1295b3551-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:42 devstack sudo[94887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0
Nov 05 04:20:42 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Acquiring lock "cinder-quobyte-96f1453b-706d-4880-92ff-47b1295b3551" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "cinder-quobyte-96f1453b-706d-4880-92ff-47b1295b3551" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70be9a5-b3c0-47c6-b188-ce992d1297d6]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:42 devstack sudo[94889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551
Nov 05 04:20:42 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:42 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab5e35b-7fda-45f8-be95-d3067ce9473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcf2b27-37c1-4afb-90d5-d4902d83e494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Volume volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0 (b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0): created successfully
Nov 05 04:20:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdcf2b27-37c1-4afb-90d5-d4902d83e494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Flow 'volume_create_manager' (5b99357a-81fe-422b-8cbc-12f296f4a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cc17e898-1d98-4a78-9ebe-75040891943e tempest-VolumesActionsTest-2128665533 None] Created volume successfully.
Nov 05 04:20:43 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551" returned: 0 in 0.483s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:43 devstack sudo[94904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551
Nov 05 04:20:43 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-91f42640-e491-4789-9a6c-b6ade496ce72 req-d7d66f67-c0fd-4bec-b6c6-6a688ca7c867 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-91f42640-e491-4789-9a6c-b6ade496ce72 req-d7d66f67-c0fd-4bec-b6c6-6a688ca7c867 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Flow 'volume_create_manager' (f6c622c7-2425-4c06-a99d-fe42b3385bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8d9784-2470-43eb-8f0c-7d9c1977bcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-91f42640-e491-4789-9a6c-b6ade496ce72 req-d7d66f67-c0fd-4bec-b6c6-6a688ca7c867 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8d9784-2470-43eb-8f0c-7d9c1977bcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-406586403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43126cfa-cbb8-47b3-82cc-bb55d9bb0dba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34f92db7b48043aaae9710e78c4e6e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:43Z,use_quota=True,user_id='0276f6fe523140eeb9455312928e6f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12211d9-de60-4a9d-a636-8753c15669fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f12211d9-de60-4a9d-a636-8753c15669fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bfd23a-5f72-4d3a-b87b-3e3af9714176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bfd23a-5f72-4d3a-b87b-3e3af9714176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43126cfa-cbb8-47b3-82cc-bb55d9bb0dba', 'volume_name': 'volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb08c18-488b-4c2f-bc6d-7035ddc23813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eb08c18-488b-4c2f-bc6d-7035ddc23813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5038d9-f06d-43d3-9cc1-5052af43f5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:43 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Volume 43126cfa-cbb8-47b3-82cc-bb55d9bb0dba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba', 'volume_size': 1}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-406586403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43126cfa-cbb8-47b3-82cc-bb55d9bb0dba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34f92db7b48043aaae9710e78c4e6e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:43Z,use_quota=True,user_id='0276f6fe523140eeb9455312928e6f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Creating volume 43126cfa-cbb8-47b3-82cc-bb55d9bb0dba {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:43 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:43 devstack sudo[94906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba 1073741824
Nov 05 04:20:43 devstack sudo[94906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-91f42640-e491-4789-9a6c-b6ade496ce72 req-d7d66f67-c0fd-4bec-b6c6-6a688ca7c867 tempest-AttachVolumeTestJSON-1529889698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fa47446-5fb2-4747-9482-d571270823a9', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:20:43 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96f1453b-706d-4880-92ff-47b1295b3551" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "cinder-quobyte-96f1453b-706d-4880-92ff-47b1295b3551" released by "delete_volume" :: held 0.811s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-91f42640-e491-4789-9a6c-b6ade496ce72 req-d7d66f67-c0fd-4bec-b6c6-6a688ca7c867 tempest-AttachVolumeTestJSON-1529889698 None] attachment_update completed successfully.
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Created reservations ['a0cfa9f4-9ac4-4be9-82d3-f7393783b743', '0ad616fc-d667-43d6-8378-7672126118be', 'b967ad09-f14b-41ff-aee9-25349b5851f1', '30f2604c-4d70-4910-8e72-b4c7d2a8323a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:43 devstack sudo[94913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:43 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:43 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.347s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Deleted volume successfully.
Nov 05 04:20:43 devstack sudo[94906]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba 1073741824" returned: 0 in 0.649s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-086c4825-c499-4021-8470-3b72715ee84b tempest-VolumeQuotasNegativeTestJSON-1951217098 None] Lock "cinder-96f1453b-706d-4880-92ff-47b1295b3551-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:44 devstack sudo[94918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba
Nov 05 04:20:44 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:44 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba" returned: 0 in 0.345s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5038d9-f06d-43d3-9cc1-5052af43f5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850b7de7-c4ef-4250-b36d-a747bdb7cee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Volume volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba (43126cfa-cbb8-47b3-82cc-bb55d9bb0dba): created successfully
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (850b7de7-c4ef-4250-b36d-a747bdb7cee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Flow 'volume_create_manager' (f6c622c7-2425-4c06-a99d-fe42b3385bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-86a3eff6-b3d3-411c-9536-82d9e353e74f tempest-VolumesTestJSON-354948267 None] Created volume successfully.
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "cinder-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "cinder-quobyte-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-quobyte-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc59b412-4b9d-40b3-97d5-3aee232ff6b8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:44 devstack sudo[94921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0
Nov 05 04:20:44 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:45 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:45 devstack sudo[94928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0
Nov 05 04:20:45 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:45 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0" returned: 0 in 0.342s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-quobyte-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0" released by "delete_volume" :: held 0.822s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Created reservations ['7597b328-58ff-47e0-aa5a-a7b0c5a5c81a', '1e5de29b-93d3-4425-83e1-9ef212acb6c2', '48f9fecd-bce3-4022-a092-3a36b1ec9829', '750c300f-f4b2-48dd-a551-d25d0c9c546e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:45 devstack sudo[94931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:45 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Flow 'volume_create_manager' (4e3488c7-0fe4-451d-8216-ce4b4a636d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e569063e-2ca4-4a30-bac7-eb2828297a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e569063e-2ca4-4a30-bac7-eb2828297a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1386490317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e343387-9466-4bf7-9d80-e4449bbad52f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34f92db7b48043aaae9710e78c4e6e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:46Z,use_quota=True,user_id='0276f6fe523140eeb9455312928e6f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:46 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f66b5f-2490-4a64-8554-b030263cc73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f66b5f-2490-4a64-8554-b030263cc73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd0ee73-323a-4a69-b2da-615a9caeec87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd0ee73-323a-4a69-b2da-615a9caeec87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e343387-9466-4bf7-9d80-e4449bbad52f', 'volume_name': 'volume-7e343387-9466-4bf7-9d80-e4449bbad52f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987c9942-d970-4487-a357-e42e28cf3ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987c9942-d970-4487-a357-e42e28cf3ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9865dc4c-a799-45c4-8bfb-d7830cb3d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:46 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Volume 7e343387-9466-4bf7-9d80-e4449bbad52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e343387-9466-4bf7-9d80-e4449bbad52f', 'volume_size': 1}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1386490317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e343387-9466-4bf7-9d80-e4449bbad52f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34f92db7b48043aaae9710e78c4e6e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:46Z,use_quota=True,user_id='0276f6fe523140eeb9455312928e6f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Creating volume 7e343387-9466-4bf7-9d80-e4449bbad52f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:46 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.480s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:46 devstack sudo[94935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f 1073741824
Nov 05 04:20:46 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Deleted volume successfully.
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-75435b19-a7ad-4c63-847c-c86c9a10e753 tempest-VolumesActionsTest-2128665533 None] Lock "cinder-b5b261b4-7a0b-4e3b-8556-ea6fec0bc9a0-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-e414d209-e7d5-40b8-8f27-7999b40f34ed req-88403e37-8965-4c17-855b-c8e703e99ba9 tempest-AttachVolumeTestJSON-1529889698 None] Terminate volume connection completed successfully.
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-e414d209-e7d5-40b8-8f27-7999b40f34ed req-88403e37-8965-4c17-855b-c8e703e99ba9 tempest-AttachVolumeTestJSON-1529889698 None] Deleting attachment 094aa49e-cc81-4834-8197-d4c6c77267a3. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:20:46 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f 1073741824" returned: 0 in 0.551s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:46 devstack sudo[94943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f
Nov 05 04:20:46 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:47 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f" returned: 0 in 0.346s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9865dc4c-a799-45c4-8bfb-d7830cb3d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e343387-9466-4bf7-9d80-e4449bbad52f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb477276-eee5-46e7-85a0-59ac7aebd463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:47 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Volume volume-7e343387-9466-4bf7-9d80-e4449bbad52f (7e343387-9466-4bf7-9d80-e4449bbad52f): created successfully
Nov 05 04:20:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb477276-eee5-46e7-85a0-59ac7aebd463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Flow 'volume_create_manager' (4e3488c7-0fe4-451d-8216-ce4b4a636d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-598f42b8-2cc5-4380-922c-42f36d6b7dc3 tempest-VolumesTestJSON-354948267 None] Created volume successfully.
Nov 05 04:20:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-0d117aad-e9b7-4749-90bd-7fe2696ff682 req-1101b1d8-d938-41fc-b3e6-137a1ab62838 tempest-AttachVolumeTestJSON-1529889698 None] Terminate volume connection completed successfully.
Nov 05 04:20:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-0d117aad-e9b7-4749-90bd-7fe2696ff682 req-1101b1d8-d938-41fc-b3e6-137a1ab62838 tempest-AttachVolumeTestJSON-1529889698 None] Deleting attachment 3fa47446-5fb2-4747-9482-d571270823a9. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Flow 'volume_create_manager' (6adde241-1a04-4d59-b733-dee74f8a17fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83280dd-dadb-4298-8dfa-a57dcb233cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83280dd-dadb-4298-8dfa-a57dcb233cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1972414657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539fe911-c554-4174-baef-cdbc269b0c04,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34f92db7b48043aaae9710e78c4e6e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:49Z,use_quota=True,user_id='0276f6fe523140eeb9455312928e6f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1046080b-39be-4f7c-b668-866b0746aa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1046080b-39be-4f7c-b668-866b0746aa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9457058-1342-4900-9b6f-bd895e4b899d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9457058-1342-4900-9b6f-bd895e4b899d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '539fe911-c554-4174-baef-cdbc269b0c04', 'volume_name': 'volume-539fe911-c554-4174-baef-cdbc269b0c04', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44a31e1-1bed-41be-9b13-51e117951dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c44a31e1-1bed-41be-9b13-51e117951dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e30b39-48ff-491e-81f5-1918b1365e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Volume 539fe911-c554-4174-baef-cdbc269b0c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-539fe911-c554-4174-baef-cdbc269b0c04', 'volume_size': 1}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1972414657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=539fe911-c554-4174-baef-cdbc269b0c04,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='34f92db7b48043aaae9710e78c4e6e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:49Z,use_quota=True,user_id='0276f6fe523140eeb9455312928e6f83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Creating volume 539fe911-c554-4174-baef-cdbc269b0c04 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:48 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:48 devstack sudo[94975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04 1073741824
Nov 05 04:20:48 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:49 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04 1073741824" returned: 0 in 0.676s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:49 devstack sudo[94983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04
Nov 05 04:20:49 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:50 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04" returned: 0 in 0.461s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e30b39-48ff-491e-81f5-1918b1365e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-539fe911-c554-4174-baef-cdbc269b0c04', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c48a231-b433-49d8-ab53-b24e0a4eb977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:50 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Volume volume-539fe911-c554-4174-baef-cdbc269b0c04 (539fe911-c554-4174-baef-cdbc269b0c04): created successfully
Nov 05 04:20:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c48a231-b433-49d8-ab53-b24e0a4eb977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Flow 'volume_create_manager' (6adde241-1a04-4d59-b733-dee74f8a17fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-324c81a2-142f-472b-b521-98fdd001799c tempest-VolumesTestJSON-354948267 None] Created volume successfully.
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Acquiring lock "cinder-539fe911-c554-4174-baef-cdbc269b0c04-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Lock "cinder-539fe911-c554-4174-baef-cdbc269b0c04-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Acquiring lock "cinder-quobyte-539fe911-c554-4174-baef-cdbc269b0c04" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Lock "cinder-quobyte-539fe911-c554-4174-baef-cdbc269b0c04" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[25815d65-3431-4e1a-a98f-f8f58c8a96f2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:52 devstack sudo[95010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04
Nov 05 04:20:52 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Flow 'volume_create_manager' (7fd474d8-bbfc-4be7-8dda-df5f35b3c522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c089e3f9-8eb7-45fb-92c6-833e35279c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c089e3f9-8eb7-45fb-92c6-833e35279c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-709380843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdfa597-368d-417f-a204-54b4198437ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be8e667a590f4e938d4e68a86b3ed781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:53Z,use_quota=True,user_id='28260e5b0a8a4f598984a56a64d96131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97281ede-8852-4222-9480-de0922524c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97281ede-8852-4222-9480-de0922524c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b7a1aa-9a9e-479f-b1ca-686a347a5c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b7a1aa-9a9e-479f-b1ca-686a347a5c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bdfa597-368d-417f-a204-54b4198437ed', 'volume_name': 'volume-9bdfa597-368d-417f-a204-54b4198437ed', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d03e0d-1c61-45aa-8056-73ef61f6b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d03e0d-1c61-45aa-8056-73ef61f6b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a793dc-576a-46bb-ac9b-ad321c7a2018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Volume 9bdfa597-368d-417f-a204-54b4198437ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bdfa597-368d-417f-a204-54b4198437ed', 'volume_size': 1}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-709380843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdfa597-368d-417f-a204-54b4198437ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be8e667a590f4e938d4e68a86b3ed781',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:20:53Z,use_quota=True,user_id='28260e5b0a8a4f598984a56a64d96131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Creating volume 9bdfa597-368d-417f-a204-54b4198437ed {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:20:52 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:20:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:52 devstack sudo[95012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed 1073741824
Nov 05 04:20:52 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:53 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04" returned: 0 in 0.471s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:53 devstack sudo[95018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04
Nov 05 04:20:53 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:53 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-539fe911-c554-4174-baef-cdbc269b0c04" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Lock "cinder-quobyte-539fe911-c554-4174-baef-cdbc269b0c04" released by "delete_volume" :: held 0.953s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:53 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed 1073741824" returned: 0 in 0.650s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Created reservations ['52b973da-f81c-4279-b731-464296995dbe', '5971b178-120a-41da-b6f3-d57c859d83ee', 'd3034a70-7c23-472a-bd11-2df4f67dc3b9', 'd954c7ff-6400-4c47-95da-4133c4fb0ced'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:53 devstack sudo[95025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed
Nov 05 04:20:53 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:53 devstack sudo[95027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:53 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:53 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a793dc-576a-46bb-ac9b-ad321c7a2018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bdfa597-368d-417f-a204-54b4198437ed', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5315f3ec-519f-460a-b3bc-dcf0dcaa7b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:20:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Volume volume-9bdfa597-368d-417f-a204-54b4198437ed (9bdfa597-368d-417f-a204-54b4198437ed): created successfully
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5315f3ec-519f-460a-b3bc-dcf0dcaa7b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Flow 'volume_create_manager' (7fd474d8-bbfc-4be7-8dda-df5f35b3c522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:20:53 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-325fc5d0-113c-4ef6-8696-d786328fb145 tempest-VolumesServicesTestJSON-519109627 None] Created volume successfully.
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.283s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:53 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Deleted volume successfully.
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b7daaa8f-7935-4fb3-ab76-39470396b2f8 tempest-VolumesTestJSON-354948267 None] Lock "cinder-539fe911-c554-4174-baef-cdbc269b0c04-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "cinder-70001d77-cbb9-4100-9fa8-13b3ecfacfc7-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Acquiring lock "cinder-7e343387-9466-4bf7-9d80-e4449bbad52f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-70001d77-cbb9-4100-9fa8-13b3ecfacfc7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Lock "cinder-7e343387-9466-4bf7-9d80-e4449bbad52f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Acquiring lock "cinder-quobyte-7e343387-9466-4bf7-9d80-e4449bbad52f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "cinder-quobyte-70001d77-cbb9-4100-9fa8-13b3ecfacfc7" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Lock "cinder-quobyte-7e343387-9466-4bf7-9d80-e4449bbad52f" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-quobyte-70001d77-cbb9-4100-9fa8-13b3ecfacfc7" acquired by "delete_volume" :: waited 0.044s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[44703efe-5668-4b87-a2da-99c8630869fe]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c116aefc-a6e0-423d-97fc-924319a75540]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:55 devstack sudo[95033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f
Nov 05 04:20:55 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:55 devstack sudo[95034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7
Nov 05 04:20:55 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Acquiring lock "cinder-9bdfa597-368d-417f-a204-54b4198437ed-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Lock "cinder-9bdfa597-368d-417f-a204-54b4198437ed-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Acquiring lock "cinder-quobyte-9bdfa597-368d-417f-a204-54b4198437ed" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Lock "cinder-quobyte-9bdfa597-368d-417f-a204-54b4198437ed" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70a2a28-2687-4135-a1b8-bcc1f0fd3f8f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:55 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f" returned: 0 in 0.455s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:55 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7" returned: 0 in 0.445s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:55 devstack sudo[95046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f
Nov 05 04:20:55 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:55 devstack sudo[95047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7
Nov 05 04:20:55 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:55 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed
Nov 05 04:20:55 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:55 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7e343387-9466-4bf7-9d80-e4449bbad52f" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:55 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-70001d77-cbb9-4100-9fa8-13b3ecfacfc7" returned: 0 in 0.261s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Lock "cinder-quobyte-7e343387-9466-4bf7-9d80-e4449bbad52f" released by "delete_volume" :: held 0.786s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-quobyte-70001d77-cbb9-4100-9fa8-13b3ecfacfc7" released by "delete_volume" :: held 0.768s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:55 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:55 devstack sudo[95056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed
Nov 05 04:20:55 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Created reservations ['e34de1c2-e77c-44eb-9cdc-26851ac8541f', '36110b2b-574b-4b0f-87e9-2d7df5fce91d', '9a8ac993-b202-47fa-8095-c346500df599', '0a3c49f0-e044-4c6c-bad7-97a4ee765e64'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Created reservations ['318e64d6-67f7-42a4-a0a6-3ae5757af08b', 'cb761f42-bc7e-451d-9383-bf8bfe29af66', '05791176-32fc-4135-90c0-437b155053aa', '5b7a5be5-2ca5-4ed8-8a1b-00d361c918cc'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:55 devstack sudo[95058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:55 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:55 devstack sudo[95060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:55 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "cinder-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Acquiring lock "cinder-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:56 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9bdfa597-368d-417f-a204-54b4198437ed" returned: 0 in 0.401s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:56 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Lock "cinder-quobyte-9bdfa597-368d-417f-a204-54b4198437ed" released by "delete_volume" :: held 0.846s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Deleted volume successfully.
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Lock "cinder-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba-delete_volume" acquired by "delete_volume" :: waited 0.150s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "cinder-quobyte-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-quobyte-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e" acquired by "delete_volume" :: waited 0.068s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:56 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.520s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[92efbaa2-e90c-4ec9-b653-01d334e45a76]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Deleted volume successfully.
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b6e24ebd-0af6-4b16-acc4-3e1763dc7bf9 tempest-VolumesTestJSON-354948267 None] Lock "cinder-7e343387-9466-4bf7-9d80-e4449bbad52f-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Acquiring lock "cinder-quobyte-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7cfd03bf-d771-4c48-b001-d3ebbd4be816 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-70001d77-cbb9-4100-9fa8-13b3ecfacfc7-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Lock "cinder-quobyte-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Created reservations ['52306bca-e7fb-4db9-b763-4abd8ce91e43', '75041ec6-1235-48b6-a0e4-9547e9a7c01f', 'c25ada31-492e-45c5-91d8-900db18bd4e4', 'a1d579b0-4ad2-478f-8efb-f2d583fc34a1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ac2d9e-6d19-4a31-9db9-7ecdfb324123]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:56 devstack sudo[95067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e
Nov 05 04:20:56 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:56 devstack sudo[95070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:56 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:56 devstack sudo[95068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba
Nov 05 04:20:56 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:56 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:56 devstack sudo[95078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e
Nov 05 04:20:56 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:56 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.315s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Deleted volume successfully.
Nov 05 04:20:56 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba" returned: 0 in 0.444s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-849d04b4-886a-4a30-bc05-55a389e812d8 tempest-VolumesServicesTestJSON-519109627 None] Lock "cinder-9bdfa597-368d-417f-a204-54b4198437ed-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:57 devstack sudo[95085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba
Nov 05 04:20:57 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:57 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e" returned: 0 in 0.318s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-quobyte-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e" released by "delete_volume" :: held 0.831s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Created reservations ['8e1d5f5d-1430-4d2e-97b7-0dec7eea7f1b', '51bf5225-3c0c-4818-a6a1-1a25e26db6b4', 'ab1455d2-b049-4597-9176-d3e4bca28ed3', 'f0646847-37ca-497c-b7f3-86a1e371c7f6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:57 devstack sudo[95090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:57 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:57 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba" returned: 0 in 0.471s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Lock "cinder-quobyte-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba" released by "delete_volume" :: held 0.986s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Created reservations ['07968bee-fa88-4ce0-b94d-7d975e1d72f1', '35a91957-6e9c-4ffd-a491-a1073357291f', 'a40b755a-9c1c-49e9-b00a-edc7f4ae7523', '1c701f46-00a8-479c-87e7-3b1e35d63b3e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:57 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.283s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Deleted volume successfully.
Nov 05 04:20:57 devstack sudo[95093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:57 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-55c38553-0950-4527-afb6-aa8a519e2069 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-ad2f11c3-b9ea-43e3-9e24-e61e03eb572e-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:57 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.296s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:20:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Deleted volume successfully.
Nov 05 04:20:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e3d8064-e0a3-4cc0-b165-4b086ab9a04a tempest-VolumesTestJSON-354948267 None] Lock "cinder-43126cfa-cbb8-47b3-82cc-bb55d9bb0dba-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "cinder-b6d316d6-65f2-4b96-b009-464786c216d3-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-b6d316d6-65f2-4b96-b009-464786c216d3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "cinder-quobyte-b6d316d6-65f2-4b96-b009-464786c216d3" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:20:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-quobyte-b6d316d6-65f2-4b96-b009-464786c216d3" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:20:58 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0613c9-a2d8-47a4-884c-1c6de8a1bbaf]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:20:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:58 devstack sudo[95096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3
Nov 05 04:20:58 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:59 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3" returned: 0 in 0.579s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:59 devstack sudo[95102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3
Nov 05 04:20:59 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:59 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b6d316d6-65f2-4b96-b009-464786c216d3" returned: 0 in 0.285s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-quobyte-b6d316d6-65f2-4b96-b009-464786c216d3" released by "delete_volume" :: held 0.927s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Created reservations ['fbbea497-84fa-44cb-a0e2-a82125b412c6', '7eb14409-d5df-4904-9e31-e3cc110f1c77', 'e7329bda-a32d-4277-b57d-71c87358dea9', '9db9896f-e954-4ef7-92db-b655e58d5c1b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:20:59 devstack sudo[95105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:20:59 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:20:59 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:20:59 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Deleted volume successfully.
Nov 05 04:21:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8b6f9df2-7d0e-4945-9922-bc31d46251f5 tempest-AttachVolumeTestJSON-1529889698 None] Lock "cinder-b6d316d6-65f2-4b96-b009-464786c216d3-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Flow 'volume_create_manager' (e36155df-ebf4-4cea-ad7e-3b0f35f24589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ce70b1-1ced-4fa4-afd4-2e5733f75e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ce70b1-1ced-4fa4-afd4-2e5733f75e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-150408968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f5e647-8cd5-471e-9244-c4fcfdcd4489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e36312072d345068f0355775542b9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:03Z,use_quota=True,user_id='912efca9c1394051b3f0ec5eaf77dd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a232fd64-7234-4e68-8e8d-70db96b27056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a232fd64-7234-4e68-8e8d-70db96b27056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8901e960-39ce-4ce7-a77b-a8a15de3ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8901e960-39ce-4ce7-a77b-a8a15de3ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f5e647-8cd5-471e-9244-c4fcfdcd4489', 'volume_name': 'volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf11e81-0426-489d-ab21-dd3d0e251e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cf11e81-0426-489d-ab21-dd3d0e251e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce103b39-364a-4017-b1bf-dd2ec0f001ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Volume 18f5e647-8cd5-471e-9244-c4fcfdcd4489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489', 'volume_size': 1}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-150408968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f5e647-8cd5-471e-9244-c4fcfdcd4489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e36312072d345068f0355775542b9d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:03Z,use_quota=True,user_id='912efca9c1394051b3f0ec5eaf77dd80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Creating volume 18f5e647-8cd5-471e-9244-c4fcfdcd4489 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:03 devstack sudo[95109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 1073741824
Nov 05 04:21:03 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:03 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 1073741824" returned: 0 in 0.594s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:04 devstack sudo[95115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489
Nov 05 04:21:04 devstack sudo[95115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:04 devstack sudo[95115]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce103b39-364a-4017-b1bf-dd2ec0f001ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba996527-ce7c-4908-a0ae-502fd62f2b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Volume volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 (18f5e647-8cd5-471e-9244-c4fcfdcd4489): created successfully
Nov 05 04:21:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba996527-ce7c-4908-a0ae-502fd62f2b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Flow 'volume_create_manager' (e36155df-ebf4-4cea-ad7e-3b0f35f24589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5ef55d38-9b7b-4fbd-8be7-26f9f745f6ba tempest-SnapshotMetadataTestJSON-707151897 None] Created volume successfully.
Nov 05 04:21:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9ef1317b-d832-4bd1-8fcd-1ed3f1404741 tempest-BackendsCapabilitiesAdminTestsJSON-1857444478 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.538516998291, 'free_capacity_gb': 1773.538516998291, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87166) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 04:21:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d339838-c560-4201-8559-944e373271d8 tempest-BackendsCapabilitiesAdminTestsJSON-1857444478 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.538516998291, 'free_capacity_gb': 1773.538516998291, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87166) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 04:21:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Creating offline snapshot b8ec51f6-02ce-4f8e-a549-e9cb95054f16 of volume 18f5e647-8cd5-471e-9244-c4fcfdcd4489 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:21:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[991e5f65-a181-4f9a-92d7-bc2c164eb653]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:05 devstack sudo[95118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489
Nov 05 04:21:05 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:06 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489" returned: 0 in 0.522s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:06 devstack sudo[95124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 1G
Nov 05 04:21:06 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:06 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 1G" returned: 0 in 0.550s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:06 devstack sudo[95130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16
Nov 05 04:21:06 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:07 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16" returned: 0 in 0.369s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:07 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 is being set with open permissions: ugo+rw
Nov 05 04:21:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:07 devstack sudo[95135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16
Nov 05 04:21:07 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:07 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16" returned: 0 in 0.298s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:07 devstack sudo[95138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.info
Nov 05 04:21:07 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:07 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.info" returned: 0 in 0.363s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:07 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.info is being set with open permissions: ugo+rw
Nov 05 04:21:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:07 devstack sudo[95141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.info
Nov 05 04:21:07 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:08 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.info" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.588s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d51aae31-8725-498d-acc1-a56a9998dec6 tempest-SnapshotMetadataTestJSON-707151897 None] Create snapshot completed successfully
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Acquiring lock "cinder-b8ec51f6-02ce-4f8e-a549-e9cb95054f16-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-b8ec51f6-02ce-4f8e-a549-e9cb95054f16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Acquiring lock "cinder-quobyte-18f5e647-8cd5-471e-9244-c4fcfdcd4489" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-quobyte-18f5e647-8cd5-471e-9244-c4fcfdcd4489" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Acquiring lock "cinder-quobyte-b8ec51f6-02ce-4f8e-a549-e9cb95054f16" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-quobyte-b8ec51f6-02ce-4f8e-a549-e9cb95054f16" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Deleting offline snapshot b8ec51f6-02ce-4f8e-a549-e9cb95054f16 of volume 18f5e647-8cd5-471e-9244-c4fcfdcd4489 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] snapshot_file for this snap is: volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585fc33-5612-44c1-94ba-4b8543353274]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:10 devstack sudo[95145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16
Nov 05 04:21:10 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:10 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16" returned: 0 in 0.450s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe64c1f9-363a-48ec-9501-4221a974178a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:11 devstack sudo[95151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489
Nov 05 04:21:11 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:11 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489" returned: 0 in 0.503s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:11 devstack sudo[95157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16
Nov 05 04:21:11 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:11 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16" returned: 0 in 0.426s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:11 devstack sudo[95163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16
Nov 05 04:21:11 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:12 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489.b8ec51f6-02ce-4f8e-a549-e9cb95054f16" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-quobyte-b8ec51f6-02ce-4f8e-a549-e9cb95054f16" released by "_delete_snapshot" :: held 1.897s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-quobyte-18f5e647-8cd5-471e-9244-c4fcfdcd4489" released by "delete_snapshot" :: held 1.938s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Created reservations ['ccdebb70-f0af-4f60-8ad1-50318cac40b4', 'bedd3459-d78b-46cf-bfc9-0e0d5d97b7f6', '8dfa0cd1-3dac-4ac3-b91b-bb6b9099b805', '247fb382-6060-4df6-a207-231ecb8148c5'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Delete snapshot completed successfully.
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76140a28-6b28-430e-a323-ffe044003dd8 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-b8ec51f6-02ce-4f8e-a549-e9cb95054f16-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Acquiring lock "cinder-18f5e647-8cd5-471e-9244-c4fcfdcd4489-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-18f5e647-8cd5-471e-9244-c4fcfdcd4489-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Acquiring lock "cinder-quobyte-18f5e647-8cd5-471e-9244-c4fcfdcd4489" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-quobyte-18f5e647-8cd5-471e-9244-c4fcfdcd4489" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f0e2d6-17af-4fb1-8fbd-7d1c3a4628c7]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:12 devstack sudo[95166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489
Nov 05 04:21:12 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2b7a50ca-55e5-4bb6-86cc-7d9fb7fda2a7 tempest-GroupSnapshotsTest-957810104 None] Group tempest-GroupSnapshotsTest-Group-931129759: creating
Nov 05 04:21:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2b7a50ca-55e5-4bb6-86cc-7d9fb7fda2a7 tempest-GroupSnapshotsTest-957810104 None] Group tempest-GroupSnapshotsTest-Group-931129759: created successfully
Nov 05 04:21:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2b7a50ca-55e5-4bb6-86cc-7d9fb7fda2a7 tempest-GroupSnapshotsTest-957810104 None] Create group completed successfully.
Nov 05 04:21:13 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489" returned: 0 in 0.496s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:13 devstack sudo[95171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489
Nov 05 04:21:13 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:13 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-18f5e647-8cd5-471e-9244-c4fcfdcd4489" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-quobyte-18f5e647-8cd5-471e-9244-c4fcfdcd4489" released by "delete_volume" :: held 0.861s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Created reservations ['bdf0e782-68de-4493-b6b2-fc1d1000b1aa', 'f5e0042e-ef2b-444c-a3c0-c59a264883c0', '1eb02194-36eb-4632-8401-f6a051c063ac', 'a5eb1972-6ff2-4837-8f0a-847e58715d72'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:13 devstack sudo[95174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:13 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:14 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Flow 'volume_create_manager' (8d55a615-1f71-42f5-854f-ac10991fff56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7fbde2-d668-4630-a00a-a29b6a5ddd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Deleted volume successfully.
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7fbde2-d668-4630-a00a-a29b6a5ddd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1095001201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f24247a-3199-4f54-a45b-9f21e5124304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276ec5a668314acebca7a307e82f5ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:14Z,use_quota=True,user_id='65797899d47142f89e54989fc4974384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dca24a5-cf55-4c67-8f32-697b7fba23b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dca24a5-cf55-4c67-8f32-697b7fba23b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0667b78-c35d-4a40-b575-9338e0494b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0667b78-c35d-4a40-b575-9338e0494b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f24247a-3199-4f54-a45b-9f21e5124304', 'volume_name': 'volume-1f24247a-3199-4f54-a45b-9f21e5124304', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47b1234-fa7a-4811-b913-b485c9477c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e47b1234-fa7a-4811-b913-b485c9477c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4950d7-1e44-4c24-8dee-9bbeee7004da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Volume 1f24247a-3199-4f54-a45b-9f21e5124304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f24247a-3199-4f54-a45b-9f21e5124304', 'volume_size': 1}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1095001201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f24247a-3199-4f54-a45b-9f21e5124304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='276ec5a668314acebca7a307e82f5ea3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:14Z,use_quota=True,user_id='65797899d47142f89e54989fc4974384',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Creating volume 1f24247a-3199-4f54-a45b-9f21e5124304 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:14 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9b4fa693-f53d-4022-95a8-5d7c06f8a4f6 tempest-SnapshotMetadataTestJSON-707151897 None] Lock "cinder-18f5e647-8cd5-471e-9244-c4fcfdcd4489-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:14 devstack sudo[95179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304 1073741824
Nov 05 04:21:14 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:14 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304 1073741824" returned: 0 in 0.579s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:14 devstack sudo[95185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304
Nov 05 04:21:14 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Flow 'volume_create_manager' (7f084a45-dab0-474b-949d-2b76e06c2e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072ef892-27c3-4c6c-9f58-69ec51091da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (072ef892-27c3-4c6c-9f58-69ec51091da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1736473603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ab3aa684-8a7a-46e2-821b-364cb3912a01,host='devstack@QuobyteHD#QuobyteHD',id=4cd63487-4c8c-4144-a7bc-9ac5039c2b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa86fa24275e48cda08803fe59dfa918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:15Z,use_quota=True,user_id='b305264ac8654d57a6f2afb8aeb1cca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9926c109-2779-4c67-b3ac-9b3182847704),volume_type_id=9926c109-2779-4c67-b3ac-9b3182847704)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e111df2-797d-41da-ad93-9744d8b4e08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e111df2-797d-41da-ad93-9744d8b4e08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7106e566-64bf-42ca-9d01-33b7223c415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7106e566-64bf-42ca-9d01-33b7223c415a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd63487-4c8c-4144-a7bc-9ac5039c2b7e', 'volume_name': 'volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfb33eb-025c-4707-ab47-b5fb6f07cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfb33eb-025c-4707-ab47-b5fb6f07cd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5dc296-8985-4e20-a81d-ea3841148993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Volume 4cd63487-4c8c-4144-a7bc-9ac5039c2b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e', 'volume_size': 1}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:15 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.058s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ab3aa684-8a7a-46e2-821b-364cb3912a01,created_at=2026-11-05T03:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1736473603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ab3aa684-8a7a-46e2-821b-364cb3912a01,host='devstack@QuobyteHD#QuobyteHD',id=4cd63487-4c8c-4144-a7bc-9ac5039c2b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa86fa24275e48cda08803fe59dfa918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:15Z,use_quota=True,user_id='b305264ac8654d57a6f2afb8aeb1cca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9926c109-2779-4c67-b3ac-9b3182847704),volume_type_id=9926c109-2779-4c67-b3ac-9b3182847704)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Creating volume 4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:15 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4950d7-1e44-4c24-8dee-9bbeee7004da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f24247a-3199-4f54-a45b-9f21e5124304', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e402d230-0767-456e-98cf-319536c8c575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:15 devstack sudo[95188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e 1073741824
Nov 05 04:21:15 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Volume volume-1f24247a-3199-4f54-a45b-9f21e5124304 (1f24247a-3199-4f54-a45b-9f21e5124304): created successfully
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e402d230-0767-456e-98cf-319536c8c575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Flow 'volume_create_manager' (8d55a615-1f71-42f5-854f-ac10991fff56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c0ba4fd3-7334-4f5b-aaf6-3dfb6fb98e67 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Created volume successfully.
Nov 05 04:21:15 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e 1073741824" returned: 0 in 0.663s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:15 devstack sudo[95193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e
Nov 05 04:21:15 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:16 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" returned: 0 in 0.462s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5dc296-8985-4e20-a81d-ea3841148993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a540bd9f-6c3c-4865-a1e9-aa9d75c1d13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Volume volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e (4cd63487-4c8c-4144-a7bc-9ac5039c2b7e): created successfully
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a540bd9f-6c3c-4865-a1e9-aa9d75c1d13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Flow 'volume_create_manager' (7f084a45-dab0-474b-949d-2b76e06c2e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-650a5e91-258a-497d-bc6e-6c686f1031fe tempest-GroupSnapshotsTest-957810104 None] Created volume successfully.
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Creating offline snapshot 1c186bc7-ed54-40f6-8677-9a6833c96777 of volume 1f24247a-3199-4f54-a45b-9f21e5124304 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c024c845-1767-49e4-9fdf-9d1fcb71d88f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:16 devstack sudo[95198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304
Nov 05 04:21:16 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:17 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:17 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 1G
Nov 05 04:21:17 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:17 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 1G" returned: 0 in 0.548s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f24247a-3199-4f54-a45b-9f21e5124304 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:17 devstack sudo[95217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f24247a-3199-4f54-a45b-9f21e5124304 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777
Nov 05 04:21:17 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] GroupSnapshot 1ab6bc54-91d6-4967-91ec-0b653f5bce89: creating.
Nov 05 04:21:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Group snapshot 1ab6bc54-91d6-4967-91ec-0b653f5bce89: creating. {{(pid=87166) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 04:21:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:18 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f24247a-3199-4f54-a45b-9f21e5124304 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:18 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 is being set with open permissions: ugo+rw
Nov 05 04:21:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:18 devstack sudo[95223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777
Nov 05 04:21:18 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:18 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777" returned: 0 in 0.293s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:18 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.info
Nov 05 04:21:18 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:18 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.info" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:18 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.info is being set with open permissions: ugo+rw
Nov 05 04:21:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:18 devstack sudo[95229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.info
Nov 05 04:21:18 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:19 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.info" returned: 0 in 0.329s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.522s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.301s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Creating offline snapshot a76314ac-71a8-415b-8e85-2960c4ee159b of volume 4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:21:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e10dc814-5428-42a5-9caf-a5434add2b04 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Create snapshot completed successfully
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fd579f-939b-41f5-a35a-785366411b25]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:19 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e
Nov 05 04:21:19 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:19 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" returned: 0 in 0.509s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:19 devstack sudo[95239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b 1G
Nov 05 04:21:19 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Flow 'volume_create_manager' (6db10ae3-2b25-4407-8a6f-502e33567347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68fb815-7ed8-4ac4-97e1-26c534637def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68fb815-7ed8-4ac4-97e1-26c534637def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1289866790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eabb216f-2d03-41e5-bbf0-34c407407416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7312194dfa894ff28fedbb148429d8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:20Z,use_quota=True,user_id='f07ebccb80b34d22862b51a2e7386d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea581f0-db3d-4114-b731-a4da0f65b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ea581f0-db3d-4114-b731-a4da0f65b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ba379f-f252-4fd6-a282-7401f8e96ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ba379f-f252-4fd6-a282-7401f8e96ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eabb216f-2d03-41e5-bbf0-34c407407416', 'volume_name': 'volume-eabb216f-2d03-41e5-bbf0-34c407407416', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd21719f-6593-458b-8aa3-4f55008959a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd21719f-6593-458b-8aa3-4f55008959a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e716f3e9-ff1e-47e1-9a14-b2bc43affd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Volume eabb216f-2d03-41e5-bbf0-34c407407416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eabb216f-2d03-41e5-bbf0-34c407407416', 'volume_size': 1}
Nov 05 04:21:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:20 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b 1G" returned: 0 in 0.560s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:20 devstack sudo[95245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b
Nov 05 04:21:20 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Acquiring lock "cinder-1c186bc7-ed54-40f6-8677-9a6833c96777-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-1c186bc7-ed54-40f6-8677-9a6833c96777-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Acquiring lock "cinder-quobyte-1f24247a-3199-4f54-a45b-9f21e5124304" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-quobyte-1f24247a-3199-4f54-a45b-9f21e5124304" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Acquiring lock "cinder-quobyte-1c186bc7-ed54-40f6-8677-9a6833c96777" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-quobyte-1c186bc7-ed54-40f6-8677-9a6833c96777" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Deleting offline snapshot 1c186bc7-ed54-40f6-8677-9a6833c96777 of volume 1f24247a-3199-4f54-a45b-9f21e5124304 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] snapshot_file for this snap is: volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[501119a4-5b85-4cab-a563-4d1ba351ba0d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:20 devstack sudo[95247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777
Nov 05 04:21:20 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:20 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b" returned: 0 in 0.338s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:20 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:20 devstack sudo[95252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b
Nov 05 04:21:20 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:20 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777" returned: 0 in 0.394s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f24247a-3199-4f54-a45b-9f21e5124304(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:21:20 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b" returned: 0 in 0.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f9ece7-6219-4002-8ae1-e151976bf3f6]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:20 devstack sudo[95259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.info
Nov 05 04:21:20 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:20 devstack sudo[95258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304
Nov 05 04:21:20 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:21 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.info" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:21 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:21 devstack sudo[95263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.info
Nov 05 04:21:21 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:21 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:21 devstack sudo[95268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777
Nov 05 04:21:21 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:21 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.info" returned: 0 in 0.315s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1289866790',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eabb216f-2d03-41e5-bbf0-34c407407416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7312194dfa894ff28fedbb148429d8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:20Z,use_quota=True,user_id='f07ebccb80b34d22862b51a2e7386d4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Creating volume eabb216f-2d03-41e5-bbf0-34c407407416 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:21 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:21 devstack sudo[95271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416 1073741824
Nov 05 04:21:21 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3970445a-bffc-4ddd-95f6-5a7cea538742 tempest-GroupSnapshotsTest-957810104 None] group_snapshot 1ab6bc54-91d6-4967-91ec-0b653f5bce89: created successfully
Nov 05 04:21:21 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777" returned: 0 in 0.456s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:21 devstack sudo[95276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777
Nov 05 04:21:21 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:22 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304.1c186bc7-ed54-40f6-8677-9a6833c96777" returned: 0 in 0.370s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-quobyte-1c186bc7-ed54-40f6-8677-9a6833c96777" released by "_delete_snapshot" :: held 1.785s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-quobyte-1f24247a-3199-4f54-a45b-9f21e5124304" released by "delete_snapshot" :: held 1.823s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:22 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416 1073741824" returned: 0 in 0.721s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:22 devstack sudo[95283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416
Nov 05 04:21:22 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Created reservations ['4d093389-5d43-4923-a707-ed6ae74d890c', 'f336eff8-6573-47ba-83ce-05b9f2187ebe', 'bd26615d-05e5-42a2-989a-d320475cc928', '9a2a0381-2abd-4251-956d-fe93680a29db'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Delete snapshot completed successfully.
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff2f3980-af83-4893-abda-a3f07bd7c8b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-1c186bc7-ed54-40f6-8677-9a6833c96777-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:22 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e716f3e9-ff1e-47e1-9a14-b2bc43affd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eabb216f-2d03-41e5-bbf0-34c407407416', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f04eae-d6d4-4fe0-826a-6b7550567bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Acquiring lock "cinder-1f24247a-3199-4f54-a45b-9f21e5124304-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Volume volume-eabb216f-2d03-41e5-bbf0-34c407407416 (eabb216f-2d03-41e5-bbf0-34c407407416): created successfully
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3f04eae-d6d4-4fe0-826a-6b7550567bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Flow 'volume_create_manager' (6db10ae3-2b25-4407-8a6f-502e33567347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-1f24247a-3199-4f54-a45b-9f21e5124304-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dacdd4c7-9f9f-4348-b83e-43270c1bdc9c tempest-AbsoluteLimitsTests-750751789 None] Created volume successfully.
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Acquiring lock "cinder-quobyte-1f24247a-3199-4f54-a45b-9f21e5124304" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-quobyte-1f24247a-3199-4f54-a45b-9f21e5124304" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256230e-d214-470d-9e4a-58c2f78da1dc]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:23 devstack sudo[95286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304
Nov 05 04:21:23 devstack sudo[95286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Acquiring lock "cinder-eabb216f-2d03-41e5-bbf0-34c407407416-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Lock "cinder-eabb216f-2d03-41e5-bbf0-34c407407416-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Acquiring lock "cinder-quobyte-eabb216f-2d03-41e5-bbf0-34c407407416" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Lock "cinder-quobyte-eabb216f-2d03-41e5-bbf0-34c407407416" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-a76314ac-71a8-415b-8e85-2960c4ee159b-ece33618-07bd-4516-954c-5ff178d0a97c" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[27358aff-3123-466b-bf2c-458f37328e9e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:23 devstack sudo[95286]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-a76314ac-71a8-415b-8e85-2960c4ee159b-ece33618-07bd-4516-954c-5ff178d0a97c" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Creating volume ece33618-07bd-4516-954c-5ff178d0a97c from snapshot a76314ac-71a8-415b-8e85-2960c4ee159b {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-ece33618-07bd-4516-954c-5ff178d0a97c" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304" returned: 0 in 0.642s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-ece33618-07bd-4516-954c-5ff178d0a97c" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] snapshot: a76314ac-71a8-415b-8e85-2960c4ee159b, volume: ece33618-07bd-4516-954c-5ff178d0a97c,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:21:23 devstack sudo[95292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304
Nov 05 04:21:23 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:23 devstack sudo[95291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416
Nov 05 04:21:23 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa85478-7e8c-4e8f-97ef-7c6a83ec11f2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:23 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:23 devstack sudo[95295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1f24247a-3199-4f54-a45b-9f21e5124304" returned: 0 in 0.366s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:23 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-quobyte-1f24247a-3199-4f54-a45b-9f21e5124304" released by "delete_volume" :: held 1.105s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:23 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:24 devstack sudo[95301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416
Nov 05 04:21:24 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Created reservations ['b3229e0b-278a-4c65-bc51-7e7c1e7d639b', '86279b2e-8211-44ae-9ae6-339a4103d8b2', '7d63dd2a-45b5-4bb5-8c50-27d6370b1b36', '3bdc8cb7-9210-471c-960c-199291bd791d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:24 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:24 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:24 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b" returned: 0 in 0.580s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d56bcba-be52-4875-924b-7ec40a77815f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:24 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-eabb216f-2d03-41e5-bbf0-34c407407416" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Lock "cinder-quobyte-eabb216f-2d03-41e5-bbf0-34c407407416" released by "delete_volume" :: held 0.889s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:24 devstack sudo[95309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e
Nov 05 04:21:24 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Created reservations ['ddb20cb2-8684-49d4-b207-4b8f2c3cdc13', '0ff9ec7c-f0a9-489f-aba0-e899419e9a4f', '1f5bf87c-4a29-4b59-ad1d-b694b9e8ce5c', '9d1ce9dc-45e9-4b29-bae1-36b1965157e6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:24 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Deleted volume successfully.
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-306175b6-37c2-4976-80b7-d0e9890ab231 tempest-VolumeSnapshotQuotasNegativeTestJSON-1818975479 None] Lock "cinder-1f24247a-3199-4f54-a45b-9f21e5124304-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:24 devstack sudo[95312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:24 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:24 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" returned: 0 in 0.432s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:24 devstack sudo[95333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c
Nov 05 04:21:24 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:24 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Deleted volume successfully.
Nov 05 04:21:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec602093-d8f4-4857-96b8-a98dbda85a67 tempest-AbsoluteLimitsTests-750751789 None] Lock "cinder-eabb216f-2d03-41e5-bbf0-34c407407416-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:29 devstack sudo[95380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:29 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:29 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.512s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:21:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:21:34 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=171,cinder:SELECT=148,cinder:DELETE=18,cinder:INSERT=42 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:21:34 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c" returned: 0 in 9.946s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:34 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e, size 1024.00 MB, duration 9.95 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:21:34 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Converted 1024.00 MB image at 102.93 MB/s
Nov 05 04:21:34 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:21:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:34 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c
Nov 05 04:21:34 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:34 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=174,cinder:SELECT=129,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:21:34 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c" returned: 0 in 0.302s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-ece33618-07bd-4516-954c-5ff178d0a97c" released by "_copy_volume_from_snapshot" :: held 11.418s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-a76314ac-71a8-415b-8e85-2960c4ee159b-ece33618-07bd-4516-954c-5ff178d0a97c" released by "_create_volume_from_snapshot" :: held 11.553s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.600s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bb5f5513-5d76-484c-a3bf-4839bcd01ca2 tempest-GroupSnapshotsTest-957810104 None] Create group from source-snapshot-1ab6bc54-91d6-4967-91ec-0b653f5bce89 completed successfully.
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Flow 'volume_create_manager' (02f1f5d5-566a-43c1-b3aa-5e5f093f141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9135214f-65da-4460-b8cd-a86c6cc93b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9135214f-65da-4460-b8cd-a86c6cc93b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-746831010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96741d77-aefb-47cf-b27b-ab498034d99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9257d7dbe346f59cf1173c9002ef39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:36Z,use_quota=True,user_id='b942b44e1b2b4632bbb1d85ce7d045c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e40efbd-035b-4634-a58c-d0491205120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e40efbd-035b-4634-a58c-d0491205120c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2b0d0a-d99d-4fe9-aba4-d7ff3ba60615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e2b0d0a-d99d-4fe9-aba4-d7ff3ba60615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96741d77-aefb-47cf-b27b-ab498034d99d', 'volume_name': 'volume-96741d77-aefb-47cf-b27b-ab498034d99d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139bf1d3-b621-4e5d-8317-3b71e1478e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (139bf1d3-b621-4e5d-8317-3b71e1478e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dca0364-7cb1-471d-8632-29257e0e7531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Volume 96741d77-aefb-47cf-b27b-ab498034d99d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96741d77-aefb-47cf-b27b-ab498034d99d', 'volume_size': 1}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-746831010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96741d77-aefb-47cf-b27b-ab498034d99d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9257d7dbe346f59cf1173c9002ef39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:36Z,use_quota=True,user_id='b942b44e1b2b4632bbb1d85ce7d045c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Creating volume 96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:36 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:36 devstack sudo[95411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d 1073741824
Nov 05 04:21:36 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Flow 'volume_create_manager' (8dc86449-60e4-46f7-a2c8-2bcc7d39ef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09434b46-7c6b-4155-989f-f2777b16ba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09434b46-7c6b-4155-989f-f2777b16ba4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-49057711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81bcdc7-77d3-4b8b-86e3-219f553bbd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4172a5338d042ffa23b58c2fb9f13d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:37Z,use_quota=True,user_id='ddd55afb542044daba48f70719fa3388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1bff89a-590a-4a56-b7a1-8aced1086b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1bff89a-590a-4a56-b7a1-8aced1086b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6849a03e-746f-4619-84c1-b542aa7f0dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6849a03e-746f-4619-84c1-b542aa7f0dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd81bcdc7-77d3-4b8b-86e3-219f553bbd2c', 'volume_name': 'volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de4639c-5c11-4592-bbb8-4028365091a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de4639c-5c11-4592-bbb8-4028365091a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec96449d-c0ab-4f69-b903-5b818a29957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:36 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Volume d81bcdc7-77d3-4b8b-86e3-219f553bbd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c', 'volume_size': 1}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-ece33618-07bd-4516-954c-5ff178d0a97c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-ece33618-07bd-4516-954c-5ff178d0a97c" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[854c4ed8-f3b4-46ab-a7cb-e81b19e328c6]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:37 devstack sudo[95416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c
Nov 05 04:21:37 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:37 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d 1073741824" returned: 0 in 0.555s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:37 devstack sudo[95419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d
Nov 05 04:21:37 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:37 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c" returned: 0 in 0.652s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:37 devstack sudo[95456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c
Nov 05 04:21:37 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:37 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d" returned: 0 in 0.523s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-49057711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d81bcdc7-77d3-4b8b-86e3-219f553bbd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4172a5338d042ffa23b58c2fb9f13d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:37Z,use_quota=True,user_id='ddd55afb542044daba48f70719fa3388',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Creating volume d81bcdc7-77d3-4b8b-86e3-219f553bbd2c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:37 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:37 devstack sudo[95475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c 1073741824
Nov 05 04:21:37 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dca0364-7cb1-471d-8632-29257e0e7531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96741d77-aefb-47cf-b27b-ab498034d99d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c36ab80-a9c2-4276-a6b0-049de7924d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Volume volume-96741d77-aefb-47cf-b27b-ab498034d99d (96741d77-aefb-47cf-b27b-ab498034d99d): created successfully
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c36ab80-a9c2-4276-a6b0-049de7924d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Flow 'volume_create_manager' (02f1f5d5-566a-43c1-b3aa-5e5f093f141d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9a607e53-c5c3-483b-990d-936fdb41806d tempest-VolumesDeleteCascade-1823014771 None] Created volume successfully.
Nov 05 04:21:38 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ece33618-07bd-4516-954c-5ff178d0a97c" returned: 0 in 0.597s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-ece33618-07bd-4516-954c-5ff178d0a97c" released by "delete_volume" :: held 1.323s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Created reservations ['73fc6029-e0a8-4441-9143-7f09319806a0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:38 devstack cinder-volume[87166]: WARNING cinder.quota [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2010100427 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2010100427, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:21:38 devstack cinder-volume[87166]: WARNING cinder.quota [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2010100427 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2010100427, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Created reservations ['cb993386-2e40-42ef-8a80-ecdd1b4cce66', 'd99704db-97b6-4c20-bb23-a66102b84172', 'ded4871b-e7f8-4d67-b56d-6e2ed66dc2f2', '91a8841b-8463-4060-98c5-c433cb41a482'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:38 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c 1073741824" returned: 0 in 0.970s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:38 devstack sudo[95497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:38 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:38 devstack sudo[95501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:38 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:39 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] <== create_volume: return (1426ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.163s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec96449d-c0ab-4f69-b903-5b818a29957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004568c0-f27f-4fd6-8e52-87aca3104628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Creating offline snapshot a80deda5-438d-442d-b263-e00560d1e0e1 of volume 96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:21:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Volume volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c (d81bcdc7-77d3-4b8b-86e3-219f553bbd2c): created successfully
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (004568c0-f27f-4fd6-8e52-87aca3104628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Flow 'volume_create_manager' (8dc86449-60e4-46f7-a2c8-2bcc7d39ef91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b79bdd-e459-4b08-8b5d-33dd1ff0a351]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1ef4c5e0-91e0-4d11-adf9-90c321b87125 tempest-VolumesMetadataTest-1836744797 None] Created volume successfully.
Nov 05 04:21:39 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.507s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9458493e-1161-407f-a08e-77e30dfad424 tempest-GroupSnapshotsTest-957810104 None] Delete group completed successfully.
Nov 05 04:21:39 devstack sudo[95508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d
Nov 05 04:21:39 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] group_snapshot 1ab6bc54-91d6-4967-91ec-0b653f5bce89: deleting
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] group_snapshot 1ab6bc54-91d6-4967-91ec-0b653f5bce89: deleting {{(pid=87166) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-a76314ac-71a8-415b-8e85-2960c4ee159b" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-a76314ac-71a8-415b-8e85-2960c4ee159b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Deleting offline snapshot a76314ac-71a8-415b-8e85-2960c4ee159b of volume 4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] snapshot_file for this snap is: volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b59de0e-333a-4a31-a5f1-ce280f053f9d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:39 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d" returned: 0 in 0.706s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:40 devstack sudo[95514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 1G
Nov 05 04:21:40 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:40 devstack sudo[95512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b
Nov 05 04:21:40 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:40 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b" returned: 0 in 0.559s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:21:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7190cbe4-9e07-4b5e-b8b0-3f6d1b6c27fc]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:40 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 1G" returned: 0 in 0.614s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:40 devstack sudo[95524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e
Nov 05 04:21:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96741d77-aefb-47cf-b27b-ab498034d99d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:40 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:40 devstack sudo[95527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96741d77-aefb-47cf-b27b-ab498034d99d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1
Nov 05 04:21:40 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Acquiring lock "cinder-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Lock "cinder-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Acquiring lock "cinder-quobyte-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Lock "cinder-quobyte-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b4ca1b-72ae-41b0-a33f-b91efff57e84]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:41 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96741d77-aefb-47cf-b27b-ab498034d99d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1" returned: 0 in 0.604s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:41 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 is being set with open permissions: ugo+rw
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:41 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" returned: 0 in 0.788s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:41 devstack sudo[95536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1
Nov 05 04:21:41 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:41 devstack sudo[95537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b
Nov 05 04:21:41 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:41 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c
Nov 05 04:21:41 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:41 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1" returned: 0 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:41 devstack sudo[95549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.info
Nov 05 04:21:41 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:41 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c" returned: 0 in 0.589s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:41 devstack sudo[95551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c
Nov 05 04:21:41 devstack sudo[95551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:41 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b" returned: 0 in 0.568s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:41 devstack sudo[95553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b
Nov 05 04:21:41 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:42 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.info" returned: 0 in 0.519s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:42 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.info is being set with open permissions: ugo+rw
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:42 devstack sudo[95551]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c" returned: 0 in 0.468s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Lock "cinder-quobyte-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c" released by "delete_volume" :: held 1.123s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:42 devstack sudo[95557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.info
Nov 05 04:21:42 devstack sudo[95557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Created reservations ['849eb8fc-f573-4f3c-9d7e-af94ff212906', 'c6047e8c-8884-46ad-a04a-126074f013f1', '1e25e5f5-f3ab-4b51-a47f-5b358b47f886', '9aba51f0-1f4e-4f09-8b9e-92ce617c5d23'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:42 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e.a76314ac-71a8-415b-8e85-2960c4ee159b" returned: 0 in 0.515s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-a76314ac-71a8-415b-8e85-2960c4ee159b" released by "_delete_snapshot" :: held 2.593s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" released by "delete_snapshot" :: held 2.645s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:42 devstack cinder-volume[87166]: WARNING cinder.quota [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2010100427 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2010100427, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:21:42 devstack sudo[95561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:42 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:42 devstack sudo[95557]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.info" returned: 0 in 0.437s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.485s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] Created reservations ['3c54c5f4-2ac6-4da6-9aca-76c99e7c8c9d', '6db7fc4b-ea59-4349-900e-5ca27598262d', 'dd1e0d00-9252-498f-8491-6ffd71cd6e2e', 'dd8176c2-dc03-4057-bbfb-768e75a4e5af'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-01f41f49-a0ae-4123-9fb5-da382a758753 tempest-VolumesDeleteCascade-1823014771 None] Create snapshot completed successfully
Nov 05 04:21:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-96a7de4c-9b12-4e7c-b405-d5f9f728822c tempest-GroupSnapshotsTest-957810104 None] group_snapshot 1ab6bc54-91d6-4967-91ec-0b653f5bce89: deleted successfully
Nov 05 04:21:42 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.331s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Deleted volume successfully.
Nov 05 04:21:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5587ab6-b1f5-4810-ad8f-06f72d4910d3 tempest-VolumesMetadataTest-1836744797 None] Lock "cinder-d81bcdc7-77d3-4b8b-86e3-219f553bbd2c-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Creating offline snapshot 46eed460-1b93-465d-9e4f-17c3cd2bb450 of volume 96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:21:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a393362b-3db7-42b4-a402-97e5302f0d8f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[943b9e3f-0b65-4177-9c26-931f99af5f31]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:43 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1
Nov 05 04:21:43 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:44 devstack sudo[95569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e
Nov 05 04:21:44 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:44 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1" returned: 0 in 0.554s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96741d77-aefb-47cf-b27b-ab498034d99d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:44 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:44 devstack sudo[95578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 1G
Nov 05 04:21:44 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:44 devstack sudo[95580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e
Nov 05 04:21:44 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:44 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-4cd63487-4c8c-4144-a7bc-9ac5039c2b7e" released by "delete_volume" :: held 0.805s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Created reservations ['4361589e-b0b8-49bb-9c86-9e0cf088e481'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:44 devstack cinder-volume[87166]: WARNING cinder.db.api [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2010100427']
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Created reservations ['de5b22bc-5576-488b-b6da-7cd69ddb89d5', '8e94742d-5b4f-457c-ba03-d3ee2c1fd9fd', '0b64983e-06cb-4173-bfb7-bf0459504d45', 'ef35e99b-b2ca-4c36-a776-d56778f8faaa'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:44 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 1G" returned: 0 in 0.658s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:45 devstack sudo[95587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450
Nov 05 04:21:45 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:45 devstack sudo[95589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:45 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:45 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.313s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-439c2457-2eb4-41cb-9c63-f7d74ab8138b tempest-GroupSnapshotsTest-957810104 None] Delete group completed successfully.
Nov 05 04:21:45 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450" returned: 0 in 0.459s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:45 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 is being set with open permissions: ugo+rw
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:45 devstack sudo[95595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450
Nov 05 04:21:45 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:45 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.145s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bedd86b8-a159-4637-90f6-31ab73a803cc tempest-VolumesDeleteCascade-1823014771 None] Create snapshot completed successfully
Nov 05 04:21:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a88fdaff-9103-492b-960d-c6140a2a59ea tempest-GroupSnapshotsTest-957810104 None] Group tempest-GroupSnapshotsTest-Group-178536151: creating
Nov 05 04:21:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a88fdaff-9103-492b-960d-c6140a2a59ea tempest-GroupSnapshotsTest-957810104 None] Group tempest-GroupSnapshotsTest-Group-178536151: created successfully
Nov 05 04:21:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a88fdaff-9103-492b-960d-c6140a2a59ea tempest-GroupSnapshotsTest-957810104 None] Create group completed successfully.
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-96741d77-aefb-47cf-b27b-ab498034d99d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-96741d77-aefb-47cf-b27b-ab498034d99d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Performing cascade delete. {{(pid=87166) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-46eed460-1b93-465d-9e4f-17c3cd2bb450-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-46eed460-1b93-465d-9e4f-17c3cd2bb450-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-96741d77-aefb-47cf-b27b-ab498034d99d" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-96741d77-aefb-47cf-b27b-ab498034d99d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-46eed460-1b93-465d-9e4f-17c3cd2bb450" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-46eed460-1b93-465d-9e4f-17c3cd2bb450" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Deleting offline snapshot 46eed460-1b93-465d-9e4f-17c3cd2bb450 of volume 96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] snapshot_file for this snap is: volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc576c-93db-47d7-bed0-e1dc9f62c33a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:47 devstack sudo[95598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450
Nov 05 04:21:47 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:47 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450" returned: 0 in 0.404s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96741d77-aefb-47cf-b27b-ab498034d99d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:21:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b716ae0-aa9f-454d-9fe7-6c510e1485e3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:47 devstack sudo[95603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1
Nov 05 04:21:47 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:47 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1" returned: 0 in 0.537s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96741d77-aefb-47cf-b27b-ab498034d99d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:21:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:47 devstack sudo[95608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450
Nov 05 04:21:47 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Flow 'volume_create_manager' (f418c691-8ecf-464f-94e0-b83c2a725fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb1c436-2ac3-4d06-9ac0-d2a6a3a68995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb1c436-2ac3-4d06-9ac0-d2a6a3a68995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683212668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4f20162a-4204-4000-9336-678c121b215b,host='devstack@QuobyteHD#QuobyteHD',id=cfae796e-7765-4a75-beda-f5de0a6b70cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa86fa24275e48cda08803fe59dfa918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:48Z,use_quota=True,user_id='b305264ac8654d57a6f2afb8aeb1cca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(100cf1c2-a50c-4160-9b92-5778fc52ee31),volume_type_id=100cf1c2-a50c-4160-9b92-5778fc52ee31)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a18e4ed-c7fd-4d6b-b1ba-d12137f04f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:48 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a18e4ed-c7fd-4d6b-b1ba-d12137f04f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c078e9ad-3586-4ede-b8f7-4c4bbd509238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c078e9ad-3586-4ede-b8f7-4c4bbd509238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfae796e-7765-4a75-beda-f5de0a6b70cf', 'volume_name': 'volume-cfae796e-7765-4a75-beda-f5de0a6b70cf', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5101ef2c-7576-47d5-a5b1-3adf07807a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5101ef2c-7576-47d5-a5b1-3adf07807a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a000f4a7-fdbf-456a-ba33-d3fb909f3a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Volume cfae796e-7765-4a75-beda-f5de0a6b70cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfae796e-7765-4a75-beda-f5de0a6b70cf', 'volume_size': 1}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4f20162a-4204-4000-9336-678c121b215b,created_at=2026-11-05T03:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683212668',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4f20162a-4204-4000-9336-678c121b215b,host='devstack@QuobyteHD#QuobyteHD',id=cfae796e-7765-4a75-beda-f5de0a6b70cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa86fa24275e48cda08803fe59dfa918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:48Z,use_quota=True,user_id='b305264ac8654d57a6f2afb8aeb1cca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(100cf1c2-a50c-4160-9b92-5778fc52ee31),volume_type_id=100cf1c2-a50c-4160-9b92-5778fc52ee31)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Creating volume cfae796e-7765-4a75-beda-f5de0a6b70cf {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:48 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450" returned: 0 in 0.620s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:48 devstack sudo[95613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf 1073741824
Nov 05 04:21:48 devstack sudo[95613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:48 devstack sudo[95614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450
Nov 05 04:21:48 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:48 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.46eed460-1b93-465d-9e4f-17c3cd2bb450" returned: 0 in 0.345s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-46eed460-1b93-465d-9e4f-17c3cd2bb450" released by "_delete_snapshot" :: held 2.044s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-96741d77-aefb-47cf-b27b-ab498034d99d" released by "delete_snapshot" :: held 2.088s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Created reservations ['82236038-1235-4d2e-9d6c-f7280306fc9e', 'f6bb1dd8-0c59-419c-b40f-cb88729aed2b', '7d4d5acc-ffbd-4b73-9588-87b0d2680764', 'aa654cc1-a031-4da2-91be-a4eca6166375'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:49 devstack sudo[95613]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf 1073741824" returned: 0 in 0.552s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Delete snapshot completed successfully.
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-46eed460-1b93-465d-9e4f-17c3cd2bb450-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-a80deda5-438d-442d-b263-e00560d1e0e1-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:49 devstack sudo[95623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf
Nov 05 04:21:49 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-a80deda5-438d-442d-b263-e00560d1e0e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-96741d77-aefb-47cf-b27b-ab498034d99d" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-96741d77-aefb-47cf-b27b-ab498034d99d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-a80deda5-438d-442d-b263-e00560d1e0e1" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-a80deda5-438d-442d-b263-e00560d1e0e1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Deleting offline snapshot a80deda5-438d-442d-b263-e00560d1e0e1 of volume 96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] snapshot_file for this snap is: volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb732a80-5608-47b2-88dc-5aaa16704ada]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:49 devstack sudo[95625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1
Nov 05 04:21:49 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:49 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf" returned: 0 in 0.294s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a000f4a7-fdbf-456a-ba33-d3fb909f3a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfae796e-7765-4a75-beda-f5de0a6b70cf', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e68654-9ed3-44ee-8f2a-c0ed526b651f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:49 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Volume volume-cfae796e-7765-4a75-beda-f5de0a6b70cf (cfae796e-7765-4a75-beda-f5de0a6b70cf): created successfully
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4e68654-9ed3-44ee-8f2a-c0ed526b651f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Flow 'volume_create_manager' (f418c691-8ecf-464f-94e0-b83c2a725fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fe6598b9-2b69-4367-98e1-1eb958fd1b38 tempest-GroupSnapshotsTest-957810104 None] Created volume successfully.
Nov 05 04:21:49 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1" returned: 0 in 0.480s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96741d77-aefb-47cf-b27b-ab498034d99d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a9c193-d932-4cf8-9dfe-edee73b704c7]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:49 devstack sudo[95631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d
Nov 05 04:21:49 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Flow 'volume_create_manager' (ef24cfef-7f68-43a3-9170-8269717d6b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c3daa8-12d2-47a1-a4f5-cc7c0289454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17c3daa8-12d2-47a1-a4f5-cc7c0289454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1109265071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf350804-0cf4-48f6-a830-40d2d9a4e362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a443d2116c4f1a90e2b423724be1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:50Z,use_quota=True,user_id='91604feaebe644efa68613904a104b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950c7b1f-0847-44b6-8265-017f3e6afb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950c7b1f-0847-44b6-8265-017f3e6afb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d56e8d-a335-4c89-9b0e-9b2c146d9f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d56e8d-a335-4c89-9b0e-9b2c146d9f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf350804-0cf4-48f6-a830-40d2d9a4e362', 'volume_name': 'volume-cf350804-0cf4-48f6-a830-40d2d9a4e362', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:50 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6449566-c732-4a1e-bf67-31b0c5cdaa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6449566-c732-4a1e-bf67-31b0c5cdaa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a5cfbb-ed45-484d-a126-7b85bd0a7152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:50 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Volume cf350804-0cf4-48f6-a830-40d2d9a4e362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf350804-0cf4-48f6-a830-40d2d9a4e362', 'volume_size': 1}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1109265071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf350804-0cf4-48f6-a830-40d2d9a4e362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a443d2116c4f1a90e2b423724be1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:50Z,use_quota=True,user_id='91604feaebe644efa68613904a104b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Creating volume cf350804-0cf4-48f6-a830-40d2d9a4e362 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:50 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d" returned: 0 in 0.477s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:50 devstack sudo[95637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362 1073741824
Nov 05 04:21:50 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:50 devstack sudo[95638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1
Nov 05 04:21:50 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:50 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:50 devstack sudo[95650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1
Nov 05 04:21:50 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:50 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362 1073741824" returned: 0 in 0.460s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:50 devstack sudo[95652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362
Nov 05 04:21:50 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:50 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d.a80deda5-438d-442d-b263-e00560d1e0e1" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-a80deda5-438d-442d-b263-e00560d1e0e1" released by "_delete_snapshot" :: held 1.774s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-96741d77-aefb-47cf-b27b-ab498034d99d" released by "delete_snapshot" :: held 1.812s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:51 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362" returned: 0 in 0.358s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a5cfbb-ed45-484d-a126-7b85bd0a7152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf350804-0cf4-48f6-a830-40d2d9a4e362', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a7ad62-57df-4e90-b2c7-64abc7503e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Created reservations ['373f8d03-fcff-4fc9-9a95-4980997cf6a5', '7c80df8a-8f1c-4755-927e-148f842ca425', '946ae22d-aeb3-42f0-bde2-0dff8021152e', 'a13acd28-31b1-47d3-99f6-1499366c0736'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Volume volume-cf350804-0cf4-48f6-a830-40d2d9a4e362 (cf350804-0cf4-48f6-a830-40d2d9a4e362): created successfully
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a7ad62-57df-4e90-b2c7-64abc7503e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Flow 'volume_create_manager' (ef24cfef-7f68-43a3-9170-8269717d6b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-540a2009-8390-4ec5-8544-9c6854a6797c tempest-VolumesTransfersTest-1134876413 None] Created volume successfully.
Nov 05 04:21:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Delete snapshot completed successfully.
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-a80deda5-438d-442d-b263-e00560d1e0e1-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Snapshots deleted, issuing volume delete {{(pid=87166) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-96741d77-aefb-47cf-b27b-ab498034d99d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-96741d77-aefb-47cf-b27b-ab498034d99d" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5d574d-7bbb-4b09-9ec4-06ac2461d467]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:51 devstack sudo[95656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d
Nov 05 04:21:51 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Flow 'volume_create_manager' (a3de5591-8440-46c0-9a4e-433c716114e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8978d2a-dca0-4d45-b49e-8aca2e3f3ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8978d2a-dca0-4d45-b49e-8aca2e3f3ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2104536031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4f20162a-4204-4000-9336-678c121b215b,host='devstack@QuobyteHD#QuobyteHD',id=fc620592-22fd-480a-b057-8129084741ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa86fa24275e48cda08803fe59dfa918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:52Z,use_quota=True,user_id='b305264ac8654d57a6f2afb8aeb1cca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(100cf1c2-a50c-4160-9b92-5778fc52ee31),volume_type_id=100cf1c2-a50c-4160-9b92-5778fc52ee31)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062d8853-8041-4197-a21b-af360ed072d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062d8853-8041-4197-a21b-af360ed072d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c99ccc-9d28-4856-bf75-355d3b163f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c99ccc-9d28-4856-bf75-355d3b163f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc620592-22fd-480a-b057-8129084741ec', 'volume_name': 'volume-fc620592-22fd-480a-b057-8129084741ec', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46d61e5-367d-498d-acf2-005e148d0efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a46d61e5-367d-498d-acf2-005e148d0efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0f8048-472b-4ead-bd39-90318b834f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Volume fc620592-22fd-480a-b057-8129084741ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc620592-22fd-480a-b057-8129084741ec', 'volume_size': 1}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4f20162a-4204-4000-9336-678c121b215b,created_at=2026-11-05T03:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2104536031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4f20162a-4204-4000-9336-678c121b215b,host='devstack@QuobyteHD#QuobyteHD',id=fc620592-22fd-480a-b057-8129084741ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa86fa24275e48cda08803fe59dfa918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:52Z,use_quota=True,user_id='b305264ac8654d57a6f2afb8aeb1cca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(100cf1c2-a50c-4160-9b92-5778fc52ee31),volume_type_id=100cf1c2-a50c-4160-9b92-5778fc52ee31)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Creating volume fc620592-22fd-480a-b057-8129084741ec {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:51 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:51 devstack sudo[95679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec 1073741824
Nov 05 04:21:51 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:51 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d" returned: 0 in 0.494s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:51 devstack sudo[95684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d
Nov 05 04:21:51 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:52 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:52 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec 1073741824" returned: 0 in 0.482s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-96741d77-aefb-47cf-b27b-ab498034d99d" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-96741d77-aefb-47cf-b27b-ab498034d99d" released by "delete_volume" :: held 0.879s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:52 devstack sudo[95691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec
Nov 05 04:21:52 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Created reservations ['0da8fe91-e21d-42af-8894-d99d9da5c088', '36889dae-d64b-445f-9925-cf83bd08b958', 'f5e629c7-c0ac-4cea-bcda-fba1c857b151', '67ac0a7b-92f2-45af-b1c8-23aa70f19a4a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:52 devstack sudo[95693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:52 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:52 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0f8048-472b-4ead-bd39-90318b834f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc620592-22fd-480a-b057-8129084741ec', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52fb3b9-555b-49da-946a-a0f42fd392f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Volume volume-fc620592-22fd-480a-b057-8129084741ec (fc620592-22fd-480a-b057-8129084741ec): created successfully
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a52fb3b9-555b-49da-946a-a0f42fd392f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Flow 'volume_create_manager' (a3de5591-8440-46c0-9a4e-433c716114e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ac7a14fe-7b8f-4320-8d9c-ede5455df8ef tempest-GroupSnapshotsTest-957810104 None] Created volume successfully.
Nov 05 04:21:52 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Deleted volume successfully.
Nov 05 04:21:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2e561be3-f2bc-4b1e-ba78-d337afc0387a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-96741d77-aefb-47cf-b27b-ab498034d99d-delete_volume" released by "delete_volume" :: held 5.955s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8b38e494-bc3b-4cf9-aa88-ee401fd63887 tempest-GroupSnapshotsTest-957810104 None] Update group completed successfully.
Nov 05 04:21:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-45ed9ed1-1307-4fb1-8957-3a3e2799bb98 tempest-VolumesTransfersTest-286395907 None] Transfer volume completed successfully.
Nov 05 04:21:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Acquiring lock "cinder-cf350804-0cf4-48f6-a830-40d2d9a4e362-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Lock "cinder-cf350804-0cf4-48f6-a830-40d2d9a4e362-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Acquiring lock "cinder-quobyte-cf350804-0cf4-48f6-a830-40d2d9a4e362" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Lock "cinder-quobyte-cf350804-0cf4-48f6-a830-40d2d9a4e362" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ce175d-8caf-4aab-9f56-ccb326725d8f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:53 devstack sudo[95697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362
Nov 05 04:21:53 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:54 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362" returned: 0 in 0.421s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:54 devstack sudo[95703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362
Nov 05 04:21:54 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Flow 'volume_create_manager' (62a65935-f183-4066-87a8-99748018eb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49529c3-002d-4362-85f1-38c4be6e6ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49529c3-002d-4362-85f1-38c4be6e6ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-697335538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6001a5a3-55d0-4ad0-87de-5d52d9fba615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9257d7dbe346f59cf1173c9002ef39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:54Z,use_quota=True,user_id='b942b44e1b2b4632bbb1d85ce7d045c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58389ee7-076e-43db-8e51-dbd69da33ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58389ee7-076e-43db-8e51-dbd69da33ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe988e6-0a06-4ed1-b4d7-0f2f2cf5d55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe988e6-0a06-4ed1-b4d7-0f2f2cf5d55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6001a5a3-55d0-4ad0-87de-5d52d9fba615', 'volume_name': 'volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f32d52-87a1-4684-a4a4-b58448444344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f32d52-87a1-4684-a4a4-b58448444344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cff4d99-a6ed-4694-bad3-50204b94d127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Volume 6001a5a3-55d0-4ad0-87de-5d52d9fba615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615', 'volume_size': 1}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-697335538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6001a5a3-55d0-4ad0-87de-5d52d9fba615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9257d7dbe346f59cf1173c9002ef39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:54Z,use_quota=True,user_id='b942b44e1b2b4632bbb1d85ce7d045c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Creating volume 6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:54 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:54 devstack sudo[95706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 1073741824
Nov 05 04:21:54 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:54 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b3bc9cb3-a190-4178-8f2a-487bef30bf38 tempest-GroupSnapshotsTest-957810104 None] Update group completed successfully.
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf350804-0cf4-48f6-a830-40d2d9a4e362" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Lock "cinder-quobyte-cf350804-0cf4-48f6-a830-40d2d9a4e362" released by "delete_volume" :: held 0.780s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Created reservations ['01d104b2-115e-461b-8f7f-a01831bceb05', '4756b92e-4148-43d0-ab2e-a77d3ff6311d', 'c8cc2ec7-a27c-4e43-bd35-c993dfb4bcbf', '5b563992-16d2-4e03-aeb1-070eb8ce8a07'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:54 devstack sudo[95708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:54 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:54 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.275s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Deleted volume successfully.
Nov 05 04:21:54 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 1073741824" returned: 0 in 0.499s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1957819f-959d-4c71-b00e-64b2d727ca8d tempest-VolumesTransfersTest-330809297 None] Lock "cinder-cf350804-0cf4-48f6-a830-40d2d9a4e362-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:54 devstack sudo[95715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615
Nov 05 04:21:54 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:55 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615" returned: 0 in 0.320s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cff4d99-a6ed-4694-bad3-50204b94d127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96647189-75bb-4865-8a0d-f5aa62562a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Volume volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 (6001a5a3-55d0-4ad0-87de-5d52d9fba615): created successfully
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96647189-75bb-4865-8a0d-f5aa62562a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Flow 'volume_create_manager' (62a65935-f183-4066-87a8-99748018eb45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-18af80fe-57b1-441a-badd-489ec500b0b5 tempest-VolumesDeleteCascade-1823014771 None] Created volume successfully.
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Flow 'volume_create_manager' (e59d4d25-e8b2-4301-813a-4bd99dff0b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84acb601-6294-4947-86f9-3f8200b5f76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84acb601-6294-4947-86f9-3f8200b5f76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1252606763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44057dc3-2763-483a-b13a-ce2139cccb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a443d2116c4f1a90e2b423724be1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:55Z,use_quota=True,user_id='91604feaebe644efa68613904a104b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16720434-d36b-4e10-b29c-97a6c113fb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16720434-d36b-4e10-b29c-97a6c113fb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7238c5e5-eb24-4b39-8a4b-f6afb90d945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7238c5e5-eb24-4b39-8a4b-f6afb90d945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44057dc3-2763-483a-b13a-ce2139cccb8a', 'volume_name': 'volume-44057dc3-2763-483a-b13a-ce2139cccb8a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b91d6e2-a49b-4dc9-8893-bfaa30faf4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b91d6e2-a49b-4dc9-8893-bfaa30faf4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3a1474-e021-4f22-8ac6-7572dfc5be7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Volume 44057dc3-2763-483a-b13a-ce2139cccb8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44057dc3-2763-483a-b13a-ce2139cccb8a', 'volume_size': 1}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1252606763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44057dc3-2763-483a-b13a-ce2139cccb8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5a443d2116c4f1a90e2b423724be1de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:21:55Z,use_quota=True,user_id='91604feaebe644efa68613904a104b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Creating volume 44057dc3-2763-483a-b13a-ce2139cccb8a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:21:55 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:55 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a 1073741824
Nov 05 04:21:55 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f073e6c7-5045-4a1e-bc95-4233412348b0 tempest-GroupSnapshotsTest-957810104 None] Update group completed successfully.
Nov 05 04:21:55 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a 1073741824" returned: 0 in 0.425s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:55 devstack sudo[95724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a
Nov 05 04:21:55 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:56 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3a1474-e021-4f22-8ac6-7572dfc5be7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44057dc3-2763-483a-b13a-ce2139cccb8a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae009f4-94d0-4141-8863-0cb7b673fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:21:56 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Volume volume-44057dc3-2763-483a-b13a-ce2139cccb8a (44057dc3-2763-483a-b13a-ce2139cccb8a): created successfully
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae009f4-94d0-4141-8863-0cb7b673fc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Flow 'volume_create_manager' (e59d4d25-e8b2-4301-813a-4bd99dff0b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:21:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2f440523-8ab9-4534-b0b5-dc413f0ce0bc tempest-VolumesTransfersTest-1134876413 None] Created volume successfully.
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Creating offline snapshot 328339f7-22f4-4a75-b4f3-fdb3f9453baf of volume 6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a9586d-cd1b-40ea-8a2e-bf222b559951]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Acquiring lock "cinder-44057dc3-2763-483a-b13a-ce2139cccb8a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Lock "cinder-44057dc3-2763-483a-b13a-ce2139cccb8a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Acquiring lock "cinder-quobyte-44057dc3-2763-483a-b13a-ce2139cccb8a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:21:56 devstack sudo[95727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615
Nov 05 04:21:56 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Lock "cinder-quobyte-44057dc3-2763-483a-b13a-ce2139cccb8a" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:21:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-07e0b4dc-b84a-4684-94ea-d230f6b7b685 tempest-GroupSnapshotsTest-957810104 None] Update group completed successfully.
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e36b816-3120-406b-be12-7809ea32df43]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:56 devstack sudo[95729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a
Nov 05 04:21:56 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:56 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615" returned: 0 in 0.424s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:56 devstack sudo[95734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf 1G
Nov 05 04:21:56 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:57 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a" returned: 0 in 0.396s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:57 devstack sudo[95739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a
Nov 05 04:21:57 devstack sudo[95739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:57 devstack sudo[95739]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-44057dc3-2763-483a-b13a-ce2139cccb8a" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:57 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf 1G" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Lock "cinder-quobyte-44057dc3-2763-483a-b13a-ce2139cccb8a" released by "delete_volume" :: held 0.733s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:57 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf
Nov 05 04:21:57 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Created reservations ['e016201d-47ae-4752-9f39-a8af373b22ab', 'bd418473-0726-4a09-9855-7d269c2a23b2', '79129251-f9e1-4bd6-80ab-f0b0484b06f0', '5bbfa72c-6293-4f71-98a6-03f517dd1d82'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:57 devstack sudo[95747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:21:57 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:57 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf" returned: 0 in 0.347s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:57 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf is being set with open permissions: ugo+rw
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:57 devstack sudo[95753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf
Nov 05 04:21:57 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:57 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.295s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:21:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Deleted volume successfully.
Nov 05 04:21:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f375ec4d-ab2f-4a9f-a0a6-6389c240741b tempest-VolumesTransfersTest-330809297 None] Lock "cinder-44057dc3-2763-483a-b13a-ce2139cccb8a-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:21:58 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:58 devstack sudo[95757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.info
Nov 05 04:21:58 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] GroupSnapshot 7165b133-c70f-449c-8dad-1ff527571b45: creating.
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Group snapshot 7165b133-c70f-449c-8dad-1ff527571b45: creating. {{(pid=87166) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:21:58 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.info" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:58 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.info is being set with open permissions: ugo+rw
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:58 devstack sudo[95760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.info
Nov 05 04:21:58 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:58 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.info" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.383s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Creating offline snapshot 6e674930-4ea3-4e0d-a390-e84239e3671f of volume fc620592-22fd-480a-b057-8129084741ec {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:21:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b0fac038-2373-4448-b327-4059c79aadab tempest-VolumesDeleteCascade-1823014771 None] Create snapshot completed successfully
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7390aca3-ed86-4739-92d9-b886cf7c94c8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:21:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:58 devstack sudo[95763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec
Nov 05 04:21:58 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:59 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec" returned: 0 in 0.424s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:59 devstack sudo[95769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f 1G
Nov 05 04:21:59 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:21:59 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root
Nov 05 04:21:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f 1G" returned: 0 in 0.535s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:21:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc620592-22fd-480a-b057-8129084741ec -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:21:59 devstack sudo[95775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc620592-22fd-480a-b057-8129084741ec -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f
Nov 05 04:21:59 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:00 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc620592-22fd-480a-b057-8129084741ec -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f" returned: 0 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:00 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:00 devstack sudo[95784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f
Nov 05 04:22:00 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Flow 'volume_create_manager' (3dc8cbef-79fd-4f01-ac2d-268882e2db86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043ef8e9-d3e1-43dd-abaa-3ae05acefb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:00 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043ef8e9-d3e1-43dd-abaa-3ae05acefb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-354696644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f495c1-009e-4115-b6ca-fe8c67cde619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9257d7dbe346f59cf1173c9002ef39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=328339f7-22f4-4a75-b4f3-fdb3f9453baf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:00Z,use_quota=True,user_id='b942b44e1b2b4632bbb1d85ce7d045c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a561b4-692e-4333-9a23-86d0d424b1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a561b4-692e-4333-9a23-86d0d424b1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167ec0e3-d507-42d1-b32c-42bf0ac26c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167ec0e3-d507-42d1-b32c-42bf0ac26c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12f495c1-009e-4115-b6ca-fe8c67cde619', 'volume_name': 'volume-12f495c1-009e-4115-b6ca-fe8c67cde619', 'volume_size': 1, 'snapshot_id': '328339f7-22f4-4a75-b4f3-fdb3f9453baf'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ab09f7-33df-4b98-90e5-2deab7d78cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92ab09f7-33df-4b98-90e5-2deab7d78cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0442d2e6-5a22-4e2b-b887-1ba0c06ef3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Volume 12f495c1-009e-4115-b6ca-fe8c67cde619: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12f495c1-009e-4115-b6ca-fe8c67cde619', 'volume_size': 1, 'snapshot_id': '328339f7-22f4-4a75-b4f3-fdb3f9453baf'}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:00 devstack sudo[95787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.info
Nov 05 04:22:00 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:00 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.info" returned: 0 in 0.273s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:00 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:22:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:00 devstack sudo[95790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.info
Nov 05 04:22:00 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:01 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.info" returned: 0 in 0.271s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.431s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Creating offline snapshot 9b07f3fe-20a8-49e3-9eb6-1ae585fc224a of volume cfae796e-7765-4a75-beda-f5de0a6b70cf {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:22:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc2f08a-6b5c-4fef-a6b4-42166c2daec2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:01 devstack sudo[95793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf
Nov 05 04:22:01 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:01 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf" returned: 0 in 0.446s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:01 devstack sudo[95798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a 1G
Nov 05 04:22:01 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:02 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a 1G" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfae796e-7765-4a75-beda-f5de0a6b70cf -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:02 devstack sudo[95805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfae796e-7765-4a75-beda-f5de0a6b70cf -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a
Nov 05 04:22:02 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:02 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfae796e-7765-4a75-beda-f5de0a6b70cf -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:02 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:22:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:02 devstack sudo[95810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a
Nov 05 04:22:02 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:02 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a" returned: 0 in 0.266s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:02 devstack sudo[95815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.info
Nov 05 04:22:02 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:02 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.info" returned: 0 in 0.258s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:02 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:22:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:02 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.info
Nov 05 04:22:02 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:03 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.info" returned: 0 in 0.296s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.745s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-328339f7-22f4-4a75-b4f3-fdb3f9453baf-12f495c1-009e-4115-b6ca-fe8c67cde619" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-328339f7-22f4-4a75-b4f3-fdb3f9453baf-12f495c1-009e-4115-b6ca-fe8c67cde619" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Creating volume 12f495c1-009e-4115-b6ca-fe8c67cde619 from snapshot 328339f7-22f4-4a75-b4f3-fdb3f9453baf {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-12f495c1-009e-4115-b6ca-fe8c67cde619" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-12f495c1-009e-4115-b6ca-fe8c67cde619" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] snapshot: 328339f7-22f4-4a75-b4f3-fdb3f9453baf, volume: 12f495c1-009e-4115-b6ca-fe8c67cde619,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f47b13-9558-4538-a60e-503a0a1665cd]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Flow 'volume_create_manager' (a750345c-e712-42bd-8637-d6da1e4cca77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471be3b4-7161-4930-9cc2-3ac22c14f45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:03 devstack sudo[95821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf
Nov 05 04:22:03 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (471be3b4-7161-4930-9cc2-3ac22c14f45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-113006431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f944edf-7aee-4efa-8753-1cc29bb0349a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754658bcba164092b99a8c40e0767c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:03Z,use_quota=True,user_id='485b3dc51b1240f686b8c8e93e8b993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0867773e-a9ba-45fa-ab67-516b7ce74f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0867773e-a9ba-45fa-ab67-516b7ce74f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a85c97d-055e-4477-8a9e-ab81505390ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a85c97d-055e-4477-8a9e-ab81505390ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f944edf-7aee-4efa-8753-1cc29bb0349a', 'volume_name': 'volume-9f944edf-7aee-4efa-8753-1cc29bb0349a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db2dffb-6e92-43cc-957e-3a0c18fb8bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7db2dffb-6e92-43cc-957e-3a0c18fb8bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbb7037-c281-4ed5-857a-a534638a5c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Volume 9f944edf-7aee-4efa-8753-1cc29bb0349a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f944edf-7aee-4efa-8753-1cc29bb0349a', 'volume_size': 1}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f221f274-aaf9-49f7-8600-cb05dd386c84 tempest-GroupSnapshotsTest-957810104 None] group_snapshot 7165b133-c70f-449c-8dad-1ff527571b45: created successfully
Nov 05 04:22:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] group_snapshot 7165b133-c70f-449c-8dad-1ff527571b45: deleting
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] group_snapshot 7165b133-c70f-449c-8dad-1ff527571b45: deleting {{(pid=87166) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-fc620592-22fd-480a-b057-8129084741ec" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-fc620592-22fd-480a-b057-8129084741ec" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-6e674930-4ea3-4e0d-a390-e84239e3671f" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-6e674930-4ea3-4e0d-a390-e84239e3671f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Deleting offline snapshot 6e674930-4ea3-4e0d-a390-e84239e3671f of volume fc620592-22fd-480a-b057-8129084741ec {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:22:03 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] snapshot_file for this snap is: volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf" returned: 0 in 0.493s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce5bb56-9c10-45cb-bc09-fbface62c17a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d37ef71-3390-44af-8a0f-422a55b54bda]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:04 devstack sudo[95828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f
Nov 05 04:22:04 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:04 devstack sudo[95827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615
Nov 05 04:22:04 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:04 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc620592-22fd-480a-b057-8129084741ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bad896e-2bee-49f4-94dd-207f7b9f3bb4]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:04 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615" returned: 0 in 0.496s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:04 devstack sudo[95838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619
Nov 05 04:22:04 devstack sudo[95838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:04 devstack sudo[95837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec
Nov 05 04:22:04 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:04 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec" returned: 0 in 0.394s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:04 devstack sudo[95847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f
Nov 05 04:22:04 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Flow 'volume_create_manager' (bed9eb5d-9f3b-4882-ba79-fcaceb2795ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1acaa7b-0907-432e-aec7-d564c476473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1acaa7b-0907-432e-aec7-d564c476473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1407274126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a18d63c-0c0d-4f2e-aa31-549e229e797a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c3afab048049ebb2ee10e49e41d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:05Z,use_quota=True,user_id='4ecb54c51abc4f299eb7ed9be4317628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af28538-f52e-41eb-9b92-c02e4f296186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9af28538-f52e-41eb-9b92-c02e4f296186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cdf502-b2b8-44fa-a588-1b6f9251eea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cdf502-b2b8-44fa-a588-1b6f9251eea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a18d63c-0c0d-4f2e-aa31-549e229e797a', 'volume_name': 'volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b815012-a942-45b5-b500-d698fe8e1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b815012-a942-45b5-b500-d698fe8e1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9317eb-2a78-4afd-af5c-305bacf8e051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Volume 4a18d63c-0c0d-4f2e-aa31-549e229e797a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a', 'volume_size': 1}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:05 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f" returned: 0 in 0.576s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:05 devstack sudo[95859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f
Nov 05 04:22:05 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:05 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec.6e674930-4ea3-4e0d-a390-e84239e3671f" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-6e674930-4ea3-4e0d-a390-e84239e3671f" released by "_delete_snapshot" :: held 1.964s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-fc620592-22fd-480a-b057-8129084741ec" released by "delete_snapshot" :: held 1.998s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-cfae796e-7765-4a75-beda-f5de0a6b70cf" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-cfae796e-7765-4a75-beda-f5de0a6b70cf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-9b07f3fe-20a8-49e3-9eb6-1ae585fc224a" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-9b07f3fe-20a8-49e3-9eb6-1ae585fc224a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Deleting offline snapshot 9b07f3fe-20a8-49e3-9eb6-1ae585fc224a of volume cfae796e-7765-4a75-beda-f5de0a6b70cf {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:22:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] snapshot_file for this snap is: volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:22:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[229a9188-8c57-4857-a5db-e4a62a760afd]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:06 devstack sudo[95862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a
Nov 05 04:22:06 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:06 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a" returned: 0 in 0.612s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfae796e-7765-4a75-beda-f5de0a6b70cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:22:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b259b5d-62fd-48ee-a0d9-e19fde2b8443]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:06 devstack sudo[95867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf
Nov 05 04:22:06 devstack sudo[95867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:07 devstack sudo[95867]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf" returned: 0 in 0.661s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:07 devstack sudo[95873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a
Nov 05 04:22:07 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:08 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a" returned: 0 in 0.670s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:08 devstack sudo[95879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a
Nov 05 04:22:08 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:08 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf.9b07f3fe-20a8-49e3-9eb6-1ae585fc224a" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-9b07f3fe-20a8-49e3-9eb6-1ae585fc224a" released by "_delete_snapshot" :: held 2.564s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-cfae796e-7765-4a75-beda-f5de0a6b70cf" released by "delete_snapshot" :: held 2.597s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:08 devstack cinder-volume[87166]: WARNING cinder.quota [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-725011367 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-725011367, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:22:08 devstack cinder-volume[87166]: WARNING cinder.quota [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-725011367 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-725011367, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:22:08 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Created reservations ['4a4c25c4-7243-4579-9362-0d28421edca3', '6d026e86-2387-4308-a334-0a68cac1a25d', 'f437967e-0225-4160-8db9-ee312ce24ff7', '24fb904f-fcd0-44fe-b1d9-e24936cd81c0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:08 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] Created reservations ['c19a6acb-f3b0-44e5-a09a-e0d0826b460a', '6826f1a7-0fc2-4e11-b17a-74467dd2bf66', '576549fc-d39f-41bd-b631-4f169945b54c', '64a69f77-ee72-48c6-a771-e9e447c25420'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-755e389d-5352-4c93-848f-d871255b78d7 tempest-GroupSnapshotsTest-957810104 None] group_snapshot 7165b133-c70f-449c-8dad-1ff527571b45: deleted successfully
Nov 05 04:22:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-cfae796e-7765-4a75-beda-f5de0a6b70cf" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-cfae796e-7765-4a75-beda-f5de0a6b70cf" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda38483-2c85-40bf-a11c-434121e13989]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:10 devstack sudo[95883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf
Nov 05 04:22:10 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:10 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf" returned: 0 in 0.541s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:10 devstack sudo[95888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf
Nov 05 04:22:10 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:11 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cfae796e-7765-4a75-beda-f5de0a6b70cf" returned: 0 in 0.508s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-cfae796e-7765-4a75-beda-f5de0a6b70cf" released by "delete_volume" :: held 1.201s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-fc620592-22fd-480a-b057-8129084741ec" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-fc620592-22fd-480a-b057-8129084741ec" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3bd1d3-8c3e-4198-b07e-a6f2f3cf60c9]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:11 devstack sudo[95892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec
Nov 05 04:22:11 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:11 devstack sudo[95838]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619" returned: 0 in 7.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:11 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:22:11 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Converted 1024.00 MB image at 138.74 MB/s
Nov 05 04:22:11 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619 is being set with open permissions: ugo+rw
Nov 05 04:22:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:11 devstack sudo[95894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619
Nov 05 04:22:11 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:12 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec" returned: 0 in 0.465s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:12 devstack sudo[95900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec
Nov 05 04:22:12 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:12 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-12f495c1-009e-4115-b6ca-fe8c67cde619" released by "_copy_volume_from_snapshot" :: held 8.736s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-328339f7-22f4-4a75-b4f3-fdb3f9453baf-12f495c1-009e-4115-b6ca-fe8c67cde619" released by "_create_volume_from_snapshot" :: held 8.812s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.850s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.496s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-113006431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f944edf-7aee-4efa-8753-1cc29bb0349a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754658bcba164092b99a8c40e0767c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:03Z,use_quota=True,user_id='485b3dc51b1240f686b8c8e93e8b993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Creating volume 9f944edf-7aee-4efa-8753-1cc29bb0349a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:22:12 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:12 devstack sudo[95902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a 1073741824
Nov 05 04:22:12 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0442d2e6-5a22-4e2b-b887-1ba0c06ef3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f495c1-009e-4115-b6ca-fe8c67cde619', 'volume_size': 1, 'snapshot_id': '328339f7-22f4-4a75-b4f3-fdb3f9453baf'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396d1918-744f-452e-92da-99c47095ac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Volume volume-12f495c1-009e-4115-b6ca-fe8c67cde619 (12f495c1-009e-4115-b6ca-fe8c67cde619): created successfully
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396d1918-744f-452e-92da-99c47095ac05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Flow 'volume_create_manager' (3dc8cbef-79fd-4f01-ac2d-268882e2db86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f8870237-f489-4727-b4f4-d5323a62e059 tempest-VolumesDeleteCascade-1823014771 None] Created volume successfully.
Nov 05 04:22:12 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fc620592-22fd-480a-b057-8129084741ec" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-fc620592-22fd-480a-b057-8129084741ec" released by "delete_volume" :: held 0.835s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Created reservations ['4c888cf6-5b89-49b3-bf27-df015a0c9091'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:12 devstack cinder-volume[87166]: WARNING cinder.quota [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-725011367 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-725011367, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Created reservations ['b1d72275-a747-4320-8bb0-1bb6fedb5b4a', '6fc59a79-b6b9-45ce-8e35-daca5b3012f4', 'adce9244-9ae8-4736-94cf-6159cd557ecf', '9d672e98-f48c-44f1-a2ba-8cb14fc4ba29'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Created reservations ['1677efaa-f43c-452d-9547-f3f6a20a3699', '5f414b9f-d1ab-44f6-a6e8-3bac6f1e8089', '8dbcfafc-85da-4394-b653-a037e96c6e0a', '76557c9e-8667-47bb-b1c7-d591bc5d6701'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:12 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a 1073741824" returned: 0 in 0.515s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:12 devstack sudo[95909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:22:12 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-6001a5a3-55d0-4ad0-87de-5d52d9fba615-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-6001a5a3-55d0-4ad0-87de-5d52d9fba615-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:12 devstack sudo[95911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a
Nov 05 04:22:12 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Performing cascade delete. {{(pid=87166) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-328339f7-22f4-4a75-b4f3-fdb3f9453baf-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-328339f7-22f4-4a75-b4f3-fdb3f9453baf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-6001a5a3-55d0-4ad0-87de-5d52d9fba615" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-6001a5a3-55d0-4ad0-87de-5d52d9fba615" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-328339f7-22f4-4a75-b4f3-fdb3f9453baf" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-328339f7-22f4-4a75-b4f3-fdb3f9453baf" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Deleting offline snapshot 328339f7-22f4-4a75-b4f3-fdb3f9453baf of volume 6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] snapshot_file for this snap is: volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[831266eb-0fbe-48fd-9f8a-dd707470919f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:12 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.347s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:22:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ce449cb8-868d-4c7a-ace8-cda6e1d010ce tempest-GroupSnapshotsTest-957810104 None] Delete group completed successfully.
Nov 05 04:22:13 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.728s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:13 devstack sudo[95914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf
Nov 05 04:22:13 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1407274126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a18d63c-0c0d-4f2e-aa31-549e229e797a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c3afab048049ebb2ee10e49e41d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:05Z,use_quota=True,user_id='4ecb54c51abc4f299eb7ed9be4317628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Creating volume 4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:22:13 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fbb7037-c281-4ed5-857a-a534638a5c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f944edf-7aee-4efa-8753-1cc29bb0349a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6718c7-a58e-4ad3-b0e7-7b147379ba81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:13 devstack sudo[95917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a 1073741824
Nov 05 04:22:13 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Volume volume-9f944edf-7aee-4efa-8753-1cc29bb0349a (9f944edf-7aee-4efa-8753-1cc29bb0349a): created successfully
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6718c7-a58e-4ad3-b0e7-7b147379ba81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Flow 'volume_create_manager' (a750345c-e712-42bd-8637-d6da1e4cca77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-99543d6a-3d32-465f-b000-a920a046cffb tempest-AttachVolumeNegativeTest-1975972844 None] Created volume successfully.
Nov 05 04:22:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-caedd38a-5846-4b89-a050-43978dd3bbb0 tempest-GroupSnapshotsTest-957810104 None] Group tempest-GroupSnapshotsTest-Group-1406831350: creating
Nov 05 04:22:13 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf" returned: 0 in 0.508s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc9e6a7-fb1c-4ab0-bedd-97857318bf97]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-caedd38a-5846-4b89-a050-43978dd3bbb0 tempest-GroupSnapshotsTest-957810104 None] Group tempest-GroupSnapshotsTest-Group-1406831350: created successfully
Nov 05 04:22:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-caedd38a-5846-4b89-a050-43978dd3bbb0 tempest-GroupSnapshotsTest-957810104 None] Create group completed successfully.
Nov 05 04:22:13 devstack sudo[95925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615
Nov 05 04:22:13 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:13 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a 1073741824" returned: 0 in 0.588s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:13 devstack sudo[95933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a
Nov 05 04:22:13 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:13 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a" returned: 0 in 0.296s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:22:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9317eb-2a78-4afd-af5c-305bacf8e051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d86f167-d75c-43e3-a31d-5ee3a2bee3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Volume volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a (4a18d63c-0c0d-4f2e-aa31-549e229e797a): created successfully
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d86f167-d75c-43e3-a31d-5ee3a2bee3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Flow 'volume_create_manager' (bed9eb5d-9f3b-4882-ba79-fcaceb2795ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-94363ab6-a76f-4e37-a141-b70f3bbdbfcd tempest-VolumesCloneTest-958562203 None] Created volume successfully.
Nov 05 04:22:14 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615" returned: 0 in 0.659s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:14 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf
Nov 05 04:22:14 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-e0912a02-0650-4272-bab1-7c457f47f8f3 req-cfe1d1ec-c43d-478a-887b-44cc99f4e33b tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-e0912a02-0650-4272-bab1-7c457f47f8f3 req-cfe1d1ec-c43d-478a-887b-44cc99f4e33b tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-e0912a02-0650-4272-bab1-7c457f47f8f3 req-cfe1d1ec-c43d-478a-887b-44cc99f4e33b tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-e0912a02-0650-4272-bab1-7c457f47f8f3 req-cfe1d1ec-c43d-478a-887b-44cc99f4e33b tempest-AttachVolumeNegativeTest-1975972844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-9f944edf-7aee-4efa-8753-1cc29bb0349a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a0811bf-1683-4219-a088-94eefa39d1c2', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:22:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-e0912a02-0650-4272-bab1-7c457f47f8f3 req-cfe1d1ec-c43d-478a-887b-44cc99f4e33b tempest-AttachVolumeNegativeTest-1975972844 None] attachment_update completed successfully.
Nov 05 04:22:14 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf" returned: 0 in 0.354s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:14 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf
Nov 05 04:22:14 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:14 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615.328339f7-22f4-4a75-b4f3-fdb3f9453baf" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-328339f7-22f4-4a75-b4f3-fdb3f9453baf" released by "_delete_snapshot" :: held 1.915s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-6001a5a3-55d0-4ad0-87de-5d52d9fba615" released by "delete_snapshot" :: held 1.945s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Created reservations ['11bbedc2-aeef-4c54-a064-2336f332c5df', '7443bbc6-5ed7-4e44-81cd-d0aefc452fd2', 'edd7d9df-5c9f-4b29-a479-9f9b02448a25', 'a8e45439-9be8-438b-b37f-701f78224685'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Delete snapshot completed successfully.
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-328339f7-22f4-4a75-b4f3-fdb3f9453baf-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Snapshots deleted, issuing volume delete {{(pid=87166) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 05 04:22:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-6001a5a3-55d0-4ad0-87de-5d52d9fba615" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-6001a5a3-55d0-4ad0-87de-5d52d9fba615" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a25b90c-fcb4-427a-89f2-2219f29322d5]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:15 devstack sudo[96373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615
Nov 05 04:22:15 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Flow 'volume_create_manager' (66786de9-fb79-4d8d-b695-fe0aacf6eea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c917fbac-558f-41e9-a271-9562a2fbabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c917fbac-558f-41e9-a271-9562a2fbabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1441092056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36bbfec7-b5dc-492c-afe1-524c82357167,host='devstack@QuobyteHD#QuobyteHD',id=22e7b521-f1af-4a25-84f1-52284b75ccf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa86fa24275e48cda08803fe59dfa918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:15Z,use_quota=True,user_id='b305264ac8654d57a6f2afb8aeb1cca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e99ed094-d270-4cee-93ba-fc6093b7fc77),volume_type_id=e99ed094-d270-4cee-93ba-fc6093b7fc77)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbad68d-e276-413a-8c75-c87d26c45cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbad68d-e276-413a-8c75-c87d26c45cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f96f49-a7cc-4eb2-beaf-028635f432fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4f96f49-a7cc-4eb2-beaf-028635f432fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e7b521-f1af-4a25-84f1-52284b75ccf5', 'volume_name': 'volume-22e7b521-f1af-4a25-84f1-52284b75ccf5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4662ff6c-9d68-4f70-9c42-cbb5a566c4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4662ff6c-9d68-4f70-9c42-cbb5a566c4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39f8010-6ee3-4ce8-be76-7343662d3211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Volume 22e7b521-f1af-4a25-84f1-52284b75ccf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e7b521-f1af-4a25-84f1-52284b75ccf5', 'volume_size': 1}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=36bbfec7-b5dc-492c-afe1-524c82357167,created_at=2026-11-05T03:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1441092056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=36bbfec7-b5dc-492c-afe1-524c82357167,host='devstack@QuobyteHD#QuobyteHD',id=22e7b521-f1af-4a25-84f1-52284b75ccf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa86fa24275e48cda08803fe59dfa918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:15Z,use_quota=True,user_id='b305264ac8654d57a6f2afb8aeb1cca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e99ed094-d270-4cee-93ba-fc6093b7fc77),volume_type_id=e99ed094-d270-4cee-93ba-fc6093b7fc77)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Creating volume 22e7b521-f1af-4a25-84f1-52284b75ccf5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:22:15 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:15 devstack sudo[96375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 1073741824
Nov 05 04:22:15 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:15 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615" returned: 0 in 0.559s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:15 devstack sudo[96381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615
Nov 05 04:22:15 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Flow 'volume_create_manager' (f4b20e62-ce8c-4abc-afa2-6e6f74ca5ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4950d31e-9377-4fbd-b582-0b32389f650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4950d31e-9377-4fbd-b582-0b32389f650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-161492941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9df597dc-1040-42c6-aeed-a2f82a4efc0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c3afab048049ebb2ee10e49e41d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=4a18d63c-0c0d-4f2e-aa31-549e229e797a,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:16Z,use_quota=True,user_id='4ecb54c51abc4f299eb7ed9be4317628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04f35cd-50f0-4605-823d-2bc13f8b5f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f04f35cd-50f0-4605-823d-2bc13f8b5f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5e7ca6-4835-4d6f-aea0-04770553050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c5e7ca6-4835-4d6f-aea0-04770553050e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9df597dc-1040-42c6-aeed-a2f82a4efc0b', 'volume_name': 'volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b', 'volume_size': 2, 'source_volid': '4a18d63c-0c0d-4f2e-aa31-549e229e797a', 'source_volstatus': 'available'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858220b2-88bc-4354-8a0b-5b3258003799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858220b2-88bc-4354-8a0b-5b3258003799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0ea094-8e6c-400e-a428-0bdc5b0a4d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Volume 9df597dc-1040-42c6-aeed-a2f82a4efc0b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b', 'volume_size': 2, 'source_volid': '4a18d63c-0c0d-4f2e-aa31-549e229e797a', 'source_volstatus': 'available'}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:15 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6001a5a3-55d0-4ad0-87de-5d52d9fba615" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-6001a5a3-55d0-4ad0-87de-5d52d9fba615" released by "delete_volume" :: held 0.934s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:15 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 1073741824" returned: 0 in 0.560s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Created reservations ['a3770576-3fe5-4f5e-b419-a4dc2044b044', 'c3c68c1c-067e-4c04-913c-276e34ce263a', '79633206-4f36-402c-8628-c3da7bf49f86', '31e1feba-ea84-4266-abd8-b880c2e63790'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:16 devstack sudo[96388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5
Nov 05 04:22:16 devstack sudo[96388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:16 devstack sudo[96390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:22:16 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:16 devstack sudo[96388]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.377s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:16 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Cloning volume 4a18d63c-0c0d-4f2e-aa31-549e229e797a to volume 9df597dc-1040-42c6-aeed-a2f82a4efc0b
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a39f8010-6ee3-4ce8-be76-7343662d3211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e7b521-f1af-4a25-84f1-52284b75ccf5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6c89e2-6f34-4167-802b-037f0f565f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:16 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:22:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Volume volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 (22e7b521-f1af-4a25-84f1-52284b75ccf5): created successfully
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6c89e2-6f34-4167-802b-037f0f565f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Flow 'volume_create_manager' (66786de9-fb79-4d8d-b695-fe0aacf6eea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Deleted volume successfully.
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Creating offline snapshot fad1d12a-17c2-414a-aa37-b378f4f3ca78 of volume 4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:22:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cb50f78c-6ca6-4f4a-adee-6f0074e41d29 tempest-GroupSnapshotsTest-957810104 None] Created volume successfully.
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea90c1f9-a178-4654-ab66-dbe57f50f6e5]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4aa0c535-3006-4dfa-b8ff-142b81d2a77a tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-6001a5a3-55d0-4ad0-87de-5d52d9fba615-delete_volume" released by "delete_volume" :: held 3.657s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:16 devstack sudo[96394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a
Nov 05 04:22:16 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] GroupSnapshot 5e410337-0ee8-44ab-89a0-785c8d936f30: creating.
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Group snapshot 5e410337-0ee8-44ab-89a0-785c8d936f30: creating. {{(pid=87166) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:16 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a" returned: 0 in 0.443s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:16 devstack sudo[96405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 1G
Nov 05 04:22:16 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-12f495c1-009e-4115-b6ca-fe8c67cde619-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-12f495c1-009e-4115-b6ca-fe8c67cde619-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:17 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 1G" returned: 0 in 0.550s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "cinder-quobyte-12f495c1-009e-4115-b6ca-fe8c67cde619" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:17 devstack sudo[96411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78
Nov 05 04:22:17 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-12f495c1-009e-4115-b6ca-fe8c67cde619" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[282a0fd7-6912-4dfb-904f-fdd7bc935e68]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:17 devstack sudo[96413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619
Nov 05 04:22:17 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:17 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:17 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 is being set with open permissions: ugo+rw
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:17 devstack sudo[96418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78
Nov 05 04:22:17 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:17 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619" returned: 0 in 0.428s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:17 devstack sudo[96423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619
Nov 05 04:22:17 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:17 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78" returned: 0 in 0.275s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:18 devstack sudo[96426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.info
Nov 05 04:22:18 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:18 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-12f495c1-009e-4115-b6ca-fe8c67cde619" returned: 0 in 0.266s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-quobyte-12f495c1-009e-4115-b6ca-fe8c67cde619" released by "delete_volume" :: held 0.755s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Created reservations ['9248f48c-7f09-42e1-bb3c-4db9b4ff2065', '8f614bf2-1c29-4ee1-9859-3695de231c20', '8223ea15-9125-441c-ab20-e30a934211d6', 'ccc26d08-8e94-44f2-8874-6607eaeb4838'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:18 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.info" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:18 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.info is being set with open permissions: ugo+rw
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:18 devstack sudo[96430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:22:18 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:18 devstack sudo[96431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.info
Nov 05 04:22:18 devstack sudo[96431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:18 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:22:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Deleted volume successfully.
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-795d2e66-5cc9-4c58-aee6-7cdac10d1ad3 tempest-VolumesDeleteCascade-1823014771 None] Lock "cinder-12f495c1-009e-4115-b6ca-fe8c67cde619-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:18 devstack sudo[96431]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.info" returned: 0 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Acquiring lock "cinder-quobyte-9df597dc-1040-42c6-aeed-a2f82a4efc0b" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Lock "cinder-quobyte-9df597dc-1040-42c6-aeed-a2f82a4efc0b" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] snapshot: fad1d12a-17c2-414a-aa37-b378f4f3ca78, volume: 9df597dc-1040-42c6-aeed-a2f82a4efc0b,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ae3a8f-66b5-4d40-86ee-9057f843d097]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:18 devstack sudo[96441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78
Nov 05 04:22:18 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:19 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78" returned: 0 in 0.489s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:22:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[647c1900-fc0e-4382-b68a-776d07f6f9f2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:19 devstack sudo[96454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a
Nov 05 04:22:19 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:19 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:22:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:22:19 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:22:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:19 devstack sudo[96459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b
Nov 05 04:22:19 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:28 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=162,cinder:INSERT=44,cinder:UPDATE=183,cinder:DELETE=9 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:22:28 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b" returned: 0 in 8.781s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:28 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a, size 1024.00 MB, duration 8.78 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:22:28 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Converted 1024.00 MB image at 116.57 MB/s
Nov 05 04:22:28 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b is being set with open permissions: ugo+rw
Nov 05 04:22:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:28 devstack sudo[96528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b
Nov 05 04:22:28 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:28 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=166,cinder:SELECT=163,cinder:DELETE=11,cinder:INSERT=41 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:29 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b" returned: 0 in 0.599s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Lock "cinder-quobyte-9df597dc-1040-42c6-aeed-a2f82a4efc0b" released by "_copy_volume_from_snapshot" :: held 10.420s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:29 devstack sudo[96560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:22:29 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Acquiring lock "cinder-quobyte-fad1d12a-17c2-414a-aa37-b378f4f3ca78" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Lock "cinder-quobyte-fad1d12a-17c2-414a-aa37-b378f4f3ca78" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Deleting offline snapshot fad1d12a-17c2-414a-aa37-b378f4f3ca78 of volume 4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] snapshot_file for this snap is: volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc45d0b2-682c-468d-81f3-9bdd94ff8048]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:29 devstack sudo[96572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78
Nov 05 04:22:29 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:29 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.485s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:22:29 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78" returned: 0 in 0.549s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d766ae-8fa7-4165-b9b5-07ae111361f4]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:30 devstack sudo[96580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a
Nov 05 04:22:30 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:30 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a" returned: 0 in 1.030s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:30 devstack sudo[96588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78
Nov 05 04:22:30 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:31 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:31 devstack sudo[96593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78
Nov 05 04:22:31 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:31 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a.fad1d12a-17c2-414a-aa37-b378f4f3ca78" returned: 0 in 0.337s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Lock "cinder-quobyte-fad1d12a-17c2-414a-aa37-b378f4f3ca78" released by "_delete_snapshot" :: held 2.599s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.635s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.125s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0ea094-8e6c-400e-a428-0bdc5b0a4d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b', 'volume_size': 2, 'source_volid': '4a18d63c-0c0d-4f2e-aa31-549e229e797a', 'source_volstatus': 'available'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b1f9ad-06a3-4ba9-ad8b-e8cbf7691901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Creating offline snapshot bceb9c97-18f0-4b01-b6e6-3a271e7b8626 of volume 22e7b521-f1af-4a25-84f1-52284b75ccf5 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:22:31 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Volume volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b (9df597dc-1040-42c6-aeed-a2f82a4efc0b): created successfully
Nov 05 04:22:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b1f9ad-06a3-4ba9-ad8b-e8cbf7691901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Flow 'volume_create_manager' (f4b20e62-ce8c-4abc-afa2-6e6f74ca5ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:32 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0737abdc-c8e5-434f-bc0c-aa7a83567fed]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a3f6bbe3-74f0-4ca9-808a-b92a279fe132 tempest-VolumesCloneTest-958562203 None] Created volume successfully.
Nov 05 04:22:32 devstack sudo[96596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5
Nov 05 04:22:32 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:32 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5" returned: 0 in 0.721s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:32 devstack sudo[96602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 1G
Nov 05 04:22:32 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Acquiring lock "cinder-9df597dc-1040-42c6-aeed-a2f82a4efc0b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Lock "cinder-9df597dc-1040-42c6-aeed-a2f82a4efc0b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:33 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 1G" returned: 0 in 0.788s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Acquiring lock "cinder-quobyte-9df597dc-1040-42c6-aeed-a2f82a4efc0b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Lock "cinder-quobyte-9df597dc-1040-42c6-aeed-a2f82a4efc0b" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:33 devstack sudo[96609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626
Nov 05 04:22:33 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc89bb60-0a28-4c37-a7da-fab08d689941]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:33 devstack sudo[96611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b
Nov 05 04:22:33 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:33 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626" returned: 0 in 0.448s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:33 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:22:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:34 devstack sudo[96618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626
Nov 05 04:22:34 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:34 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b" returned: 0 in 0.545s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:34 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b
Nov 05 04:22:34 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:34 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626" returned: 0 in 0.495s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:34 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9df597dc-1040-42c6-aeed-a2f82a4efc0b" returned: 0 in 0.363s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Lock "cinder-quobyte-9df597dc-1040-42c6-aeed-a2f82a4efc0b" released by "delete_volume" :: held 1.001s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:34 devstack sudo[96625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.info
Nov 05 04:22:34 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Created reservations ['f89089a3-f22a-45e2-a085-f2a9416ea917', '77e4d5ed-1fcb-432c-9e8a-e93d1fdf304b', 'd89d7aa5-e6e1-40d9-9301-26e57c6e576e', '95d15af5-ef8e-4818-a760-b4fc311dae73'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:34 devstack sudo[96651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:22:34 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:34 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.info" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:34 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:22:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:35 devstack sudo[96654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.info
Nov 05 04:22:35 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:35 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:35 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:22:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Deleted volume successfully.
Nov 05 04:22:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a9f26fc5-36ed-419f-a596-5f832709cecc tempest-VolumesCloneTest-958562203 None] Lock "cinder-9df597dc-1040-42c6-aeed-a2f82a4efc0b-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:35 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.info" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.487s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-732e212a-c873-454d-89e8-4b32cf0a4ed7 tempest-GroupSnapshotsTest-957810104 None] group_snapshot 5e410337-0ee8-44ab-89a0-785c8d936f30: created successfully
Nov 05 04:22:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Acquiring lock "cinder-4a18d63c-0c0d-4f2e-aa31-549e229e797a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Lock "cinder-4a18d63c-0c0d-4f2e-aa31-549e229e797a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Acquiring lock "cinder-quobyte-4a18d63c-0c0d-4f2e-aa31-549e229e797a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Lock "cinder-quobyte-4a18d63c-0c0d-4f2e-aa31-549e229e797a" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8af6c-42a9-441a-aaec-9c441895b2b4]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:36 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a
Nov 05 04:22:36 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] group_snapshot 5e410337-0ee8-44ab-89a0-785c8d936f30: deleting
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] group_snapshot 5e410337-0ee8-44ab-89a0-785c8d936f30: deleting {{(pid=87166) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 05 04:22:36 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a" returned: 0 in 0.572s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:36 devstack sudo[96663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a
Nov 05 04:22:36 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-22e7b521-f1af-4a25-84f1-52284b75ccf5" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-22e7b521-f1af-4a25-84f1-52284b75ccf5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-bceb9c97-18f0-4b01-b6e6-3a271e7b8626" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-bceb9c97-18f0-4b01-b6e6-3a271e7b8626" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Deleting offline snapshot bceb9c97-18f0-4b01-b6e6-3a271e7b8626 of volume 22e7b521-f1af-4a25-84f1-52284b75ccf5 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] snapshot_file for this snap is: volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8784ff9-578a-477e-b1fa-0ef20f18a7a9]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:37 devstack sudo[96665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626
Nov 05 04:22:37 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:37 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4a18d63c-0c0d-4f2e-aa31-549e229e797a" returned: 0 in 0.502s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Lock "cinder-quobyte-4a18d63c-0c0d-4f2e-aa31-549e229e797a" released by "delete_volume" :: held 1.181s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Created reservations ['db00ae4d-4a3c-4a88-95c6-8c1c53bec975', '0b5bf7f2-5c95-4fa7-a51f-fbb55e624ad7', '65f97c35-6dea-4214-b44e-ae41a39181ed', '0e2944bf-88cc-48aa-bee0-2a583dcbe953'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:37 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626" returned: 0 in 0.506s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22e7b521-f1af-4a25-84f1-52284b75ccf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a3ecf5-2620-4901-8765-ec54ba933756]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:37 devstack sudo[96672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:22:37 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:37 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5
Nov 05 04:22:37 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:37 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.295s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:22:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Deleted volume successfully.
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a037dd16-0b1c-4112-89d6-698a3bc51840 tempest-VolumesCloneTest-958562203 None] Lock "cinder-4a18d63c-0c0d-4f2e-aa31-549e229e797a-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:37 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5" returned: 0 in 0.462s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:37 devstack sudo[96681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626
Nov 05 04:22:37 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:38 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626" returned: 0 in 0.441s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:38 devstack sudo[96687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626
Nov 05 04:22:38 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:38 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5.bceb9c97-18f0-4b01-b6e6-3a271e7b8626" returned: 0 in 0.309s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-bceb9c97-18f0-4b01-b6e6-3a271e7b8626" released by "_delete_snapshot" :: held 1.928s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-22e7b521-f1af-4a25-84f1-52284b75ccf5" released by "delete_snapshot" :: held 1.978s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:38 devstack cinder-volume[87166]: WARNING cinder.quota [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-122344087 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-122344087, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:22:38 devstack cinder-volume[87166]: WARNING cinder.quota [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-122344087 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-122344087, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:22:38 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] Created reservations ['26bd1159-c777-4384-b8e8-51e5a3438b08', '13959c7e-6610-42af-8092-e95377b237b0', '280e9f04-782c-4cd1-bd55-780fd69ab933', '554e2b06-0314-458e-8805-8fb9cb408c2c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5379936f-1b74-4c3b-ae17-b7ee64daac59 tempest-GroupSnapshotsTest-957810104 None] group_snapshot 5e410337-0ee8-44ab-89a0-785c8d936f30: deleted successfully
Nov 05 04:22:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "cinder-quobyte-22e7b521-f1af-4a25-84f1-52284b75ccf5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:22:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-22e7b521-f1af-4a25-84f1-52284b75ccf5" acquired by "delete_volume" :: waited 0.043s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:22:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdc5eff-1be4-4ba5-9c28-5af37f52e0ff]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:39 devstack sudo[96691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5
Nov 05 04:22:39 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:40 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5" returned: 0 in 0.503s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:40 devstack sudo[96697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5
Nov 05 04:22:40 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:40 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-22e7b521-f1af-4a25-84f1-52284b75ccf5" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Lock "cinder-quobyte-22e7b521-f1af-4a25-84f1-52284b75ccf5" released by "delete_volume" :: held 1.058s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:22:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Created reservations ['b9fbf6b4-5e9d-4b50-9638-7292318ed6f7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:40 devstack cinder-volume[87166]: WARNING cinder.quota [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-122344087 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-122344087, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:22:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Created reservations ['c615c930-4c91-417e-8b2d-ea98ad04d8ac', '66cc4684-301f-4a28-ab44-0ec36be76bef', 'd77428f6-3d87-47e7-8618-9c4c4215ce0d', '05842a50-6a58-45cf-8176-146a86f9723f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:22:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:41 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:22:41 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:41 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:41 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:22:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3638c981-dfcc-43da-90c4-dd3505792548 tempest-GroupSnapshotsTest-957810104 None] Delete group completed successfully.
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Flow 'volume_create_manager' (6c5d1474-7e0e-42f9-ae98-d4d399101a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da5f6c6-d5b6-47ab-80b3-33536242a766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da5f6c6-d5b6-47ab-80b3-33536242a766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824596113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae66813-fee8-4402-bb9e-4698475d22a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fa96a2ffdab471aa6cb30203d6f52fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:43Z,use_quota=True,user_id='9441700cea78460c98d848207b548dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed91a8-d51f-4897-8f91-f5b7e27e82bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fed91a8-d51f-4897-8f91-f5b7e27e82bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b2378-9c43-4622-b534-d91ea6120106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b2378-9c43-4622-b534-d91ea6120106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ae66813-fee8-4402-bb9e-4698475d22a4', 'volume_name': 'volume-8ae66813-fee8-4402-bb9e-4698475d22a4', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054bdc4f-b41c-4a77-9d5c-72fdf3c25579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054bdc4f-b41c-4a77-9d5c-72fdf3c25579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9140c2d-d730-4960-9ef8-ecb18e0f08d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:43 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Volume 8ae66813-fee8-4402-bb9e-4698475d22a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ae66813-fee8-4402-bb9e-4698475d22a4', 'volume_size': 1}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1824596113',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ae66813-fee8-4402-bb9e-4698475d22a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fa96a2ffdab471aa6cb30203d6f52fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:43Z,use_quota=True,user_id='9441700cea78460c98d848207b548dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Creating volume 8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:22:43 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:43 devstack sudo[96723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 1073741824
Nov 05 04:22:43 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:43 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 1073741824" returned: 0 in 0.533s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:43 devstack sudo[96729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4
Nov 05 04:22:43 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:44 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4" returned: 0 in 0.326s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:22:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9140c2d-d730-4960-9ef8-ecb18e0f08d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ae66813-fee8-4402-bb9e-4698475d22a4', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04d3ef7-f7d0-49a6-ae94-ad3983ca9273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Volume volume-8ae66813-fee8-4402-bb9e-4698475d22a4 (8ae66813-fee8-4402-bb9e-4698475d22a4): created successfully
Nov 05 04:22:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04d3ef7-f7d0-49a6-ae94-ad3983ca9273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Flow 'volume_create_manager' (6c5d1474-7e0e-42f9-ae98-d4d399101a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a5e5df62-78d3-48ca-851c-8a150e905849 tempest-VolumesActionsTest-2061799973 None] Created volume successfully.
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=38,cinder:SELECT=37,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=45,cinder:SELECT=28,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (734eac5d-cbd2-44c4-a638-de06830ff1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cf967b-f172-4af6-b82e-c7354b4aebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cf967b-f172-4af6-b82e-c7354b4aebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1294280469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a38b40-a041-4b53-871c-22bb490666d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8731f288354ba0bc7fced72468eace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:55Z,use_quota=True,user_id='29ebe448143d48d8ab57cf968509e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55db8ae4-5019-4408-bac7-b27f3baa74af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55db8ae4-5019-4408-bac7-b27f3baa74af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe72ab8a-225a-4c04-857f-ba0673c34efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe72ab8a-225a-4c04-857f-ba0673c34efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a38b40-a041-4b53-871c-22bb490666d5', 'volume_name': 'volume-d3a38b40-a041-4b53-871c-22bb490666d5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51e0efa-38fe-41c6-9b56-b69052a7a809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f51e0efa-38fe-41c6-9b56-b69052a7a809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012cfcc1-554c-4518-a8fb-7d9f224ea101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Volume d3a38b40-a041-4b53-871c-22bb490666d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a38b40-a041-4b53-871c-22bb490666d5', 'volume_size': 1}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1294280469',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a38b40-a041-4b53-871c-22bb490666d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8731f288354ba0bc7fced72468eace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:22:55Z,use_quota=True,user_id='29ebe448143d48d8ab57cf968509e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Creating volume d3a38b40-a041-4b53-871c-22bb490666d5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:22:54 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:22:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:54 devstack sudo[96754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5 1073741824
Nov 05 04:22:54 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:55 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5 1073741824" returned: 0 in 0.747s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:55 devstack sudo[96762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5
Nov 05 04:22:55 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:56 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5" returned: 0 in 0.888s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:22:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012cfcc1-554c-4518-a8fb-7d9f224ea101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a38b40-a041-4b53-871c-22bb490666d5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e998a196-53da-449d-97cd-51e242098ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:22:56 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Volume volume-d3a38b40-a041-4b53-871c-22bb490666d5 (d3a38b40-a041-4b53-871c-22bb490666d5): created successfully
Nov 05 04:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e998a196-53da-449d-97cd-51e242098ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:22:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (734eac5d-cbd2-44c4-a638-de06830ff1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:22:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a84e9230-db51-436e-aecc-3471caaa9f05 tempest-VolumesSnapshotTestJSON-943709473 None] Created volume successfully.
Nov 05 04:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:22:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Creating offline snapshot 7a62aee2-cef9-4cb4-b8c6-226721a0608f of volume d3a38b40-a041-4b53-871c-22bb490666d5 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:22:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e1474-0337-4168-a484-8b50e78a6cd8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:59 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5
Nov 05 04:22:59 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:22:59 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Nov 05 04:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5" returned: 0 in 0.815s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:22:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:22:59 devstack sudo[96869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f 1G
Nov 05 04:22:59 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bc9fa468-5221-41a9-8361-e35911abae30 tempest-VolumesActionsTest-2061799973 None] Acquiring lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4" by "attach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bc9fa468-5221-41a9-8361-e35911abae30 tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4" acquired by "attach_volume" :: waited 0.070s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bc9fa468-5221-41a9-8361-e35911abae30 tempest-VolumesActionsTest-2061799973 None] Attaching volume 8ae66813-fee8-4402-bb9e-4698475d22a4 to instance 565d4abc-977a-43ed-902f-0956dda4214e at mountpoint /dev/vdb on host None.
Nov 05 04:23:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bc9fa468-5221-41a9-8361-e35911abae30 tempest-VolumesActionsTest-2061799973 None] Attach volume completed successfully.
Nov 05 04:23:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-bc9fa468-5221-41a9-8361-e35911abae30 tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4" released by "attach_volume" :: held 0.288s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c2627042-02c2-43b7-a6a6-2bb521fdcbb8 tempest-VolumesActionsTest-2061799973 None] Acquiring lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4-detach_volume" by "detach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c2627042-02c2-43b7-a6a6-2bb521fdcbb8 tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c2627042-02c2-43b7-a6a6-2bb521fdcbb8 tempest-VolumesActionsTest-2061799973 None] Detaching volume 8ae66813-fee8-4402-bb9e-4698475d22a4 from instance 565d4abc-977a-43ed-902f-0956dda4214e.
Nov 05 04:23:00 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c2627042-02c2-43b7-a6a6-2bb521fdcbb8 tempest-VolumesActionsTest-2061799973 None] Detach volume completed successfully.
Nov 05 04:23:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f 1G" returned: 0 in 0.876s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a38b40-a041-4b53-871c-22bb490666d5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c2627042-02c2-43b7-a6a6-2bb521fdcbb8 tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:00 devstack sudo[96875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a38b40-a041-4b53-871c-22bb490666d5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f
Nov 05 04:23:00 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:01 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3a38b40-a041-4b53-871c-22bb490666d5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f" returned: 0 in 0.513s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:01 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f is being set with open permissions: ugo+rw
Nov 05 04:23:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:01 devstack sudo[96880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f
Nov 05 04:23:01 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:01 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f" returned: 0 in 0.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:01 devstack sudo[96884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.info
Nov 05 04:23:01 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:02 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.info" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:02 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.info is being set with open permissions: ugo+rw
Nov 05 04:23:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:02 devstack sudo[96903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.info
Nov 05 04:23:02 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0a430ca1-204d-485b-962f-b50da91a5c62 tempest-GroupsV314Test-738098540 None] Group tempest-GroupsV314Test-Group-27234494: creating
Nov 05 04:23:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0a430ca1-204d-485b-962f-b50da91a5c62 tempest-GroupsV314Test-738098540 None] Group tempest-GroupsV314Test-Group-27234494: created successfully
Nov 05 04:23:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0a430ca1-204d-485b-962f-b50da91a5c62 tempest-GroupsV314Test-738098540 None] Create group completed successfully.
Nov 05 04:23:02 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.info" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.480s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2ad9648e-b8ca-461e-8c4c-1fe9a5fbff2d tempest-VolumesSnapshotTestJSON-943709473 None] Create snapshot completed successfully
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-7a62aee2-cef9-4cb4-b8c6-226721a0608f-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-7a62aee2-cef9-4cb4-b8c6-226721a0608f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-d3a38b40-a041-4b53-871c-22bb490666d5" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-d3a38b40-a041-4b53-871c-22bb490666d5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-7a62aee2-cef9-4cb4-b8c6-226721a0608f" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-7a62aee2-cef9-4cb4-b8c6-226721a0608f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Deleting offline snapshot 7a62aee2-cef9-4cb4-b8c6-226721a0608f of volume d3a38b40-a041-4b53-871c-22bb490666d5 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] snapshot_file for this snap is: volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b70394-c0a1-4c05-94ab-ff96edaef768]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-b8711072-dde1-4927-b49e-024c308ba845 req-7fa4b4b2-c862-4852-85f4-2635a6c2634e tempest-AttachVolumeNegativeTest-1975972844 None] Terminate volume connection completed successfully.
Nov 05 04:23:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-b8711072-dde1-4927-b49e-024c308ba845 req-7fa4b4b2-c862-4852-85f4-2635a6c2634e tempest-AttachVolumeNegativeTest-1975972844 None] Deleting attachment 6a0811bf-1683-4219-a088-94eefa39d1c2. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:23:04 devstack sudo[96928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f
Nov 05 04:23:04 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Flow 'volume_create_manager' (b8497262-0749-485d-94b3-453d0b423093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f624deb6-3e5f-4531-a70e-71bdf3f325e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f624deb6-3e5f-4531-a70e-71bdf3f325e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-438692120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e77675f-6b8f-4f0f-9668-3ac798c6d073,host='devstack@QuobyteHD#QuobyteHD',id=b2452761-011b-46f7-9f81-7eb6630298b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28892a443dc34df6bd223657cf518b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:23:04Z,use_quota=True,user_id='7a22e054b940435ca4a6368451965e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10e5e491-bb3d-4a62-872c-66a1a13b38f9),volume_type_id=10e5e491-bb3d-4a62-872c-66a1a13b38f9)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:04 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f72748c-9c18-439d-b4c9-0ef038bc1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f72748c-9c18-439d-b4c9-0ef038bc1584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c14114-851e-4e65-bd89-b506e7ce5959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c14114-851e-4e65-bd89-b506e7ce5959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2452761-011b-46f7-9f81-7eb6630298b9', 'volume_name': 'volume-b2452761-011b-46f7-9f81-7eb6630298b9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a519e3-2b65-4c5d-b297-72199506e579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a519e3-2b65-4c5d-b297-72199506e579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071be50a-ff26-4090-afec-1d8ef5b07847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Volume b2452761-011b-46f7-9f81-7eb6630298b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2452761-011b-46f7-9f81-7eb6630298b9', 'volume_size': 1}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9e77675f-6b8f-4f0f-9668-3ac798c6d073,created_at=2026-11-05T03:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-438692120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e77675f-6b8f-4f0f-9668-3ac798c6d073,host='devstack@QuobyteHD#QuobyteHD',id=b2452761-011b-46f7-9f81-7eb6630298b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28892a443dc34df6bd223657cf518b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:23:04Z,use_quota=True,user_id='7a22e054b940435ca4a6368451965e39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10e5e491-bb3d-4a62-872c-66a1a13b38f9),volume_type_id=10e5e491-bb3d-4a62-872c-66a1a13b38f9)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Creating volume b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:23:04 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f" returned: 0 in 0.666s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3a38b40-a041-4b53-871c-22bb490666d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:23:04 devstack sudo[96933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 1073741824
Nov 05 04:23:04 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5168aef7-5b56-41ac-a101-44d60f5d5663]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:04 devstack sudo[96935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5
Nov 05 04:23:04 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:05 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:05 devstack sudo[96944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f
Nov 05 04:23:05 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:05 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 1073741824" returned: 0 in 0.624s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:05 devstack sudo[96954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9
Nov 05 04:23:05 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:05 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9" returned: 0 in 0.558s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:05 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f" returned: 0 in 0.723s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071be50a-ff26-4090-afec-1d8ef5b07847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2452761-011b-46f7-9f81-7eb6630298b9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf775ce-5cd3-4b45-b7a9-c279a93c91ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:05 devstack sudo[96971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f
Nov 05 04:23:05 devstack sudo[96971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Volume volume-b2452761-011b-46f7-9f81-7eb6630298b9 (b2452761-011b-46f7-9f81-7eb6630298b9): created successfully
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf775ce-5cd3-4b45-b7a9-c279a93c91ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Flow 'volume_create_manager' (b8497262-0749-485d-94b3-453d0b423093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:23:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-afd1332a-617f-4038-9ff0-80bb350bdd2b tempest-GroupsV314Test-738098540 None] Created volume successfully.
Nov 05 04:23:06 devstack sudo[96971]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5.7a62aee2-cef9-4cb4-b8c6-226721a0608f" returned: 0 in 0.334s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-7a62aee2-cef9-4cb4-b8c6-226721a0608f" released by "_delete_snapshot" :: held 2.397s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-d3a38b40-a041-4b53-871c-22bb490666d5" released by "delete_snapshot" :: held 2.422s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Created reservations ['4567a3cf-3e09-4b6c-b61a-3ee02e411824', '0981f834-244c-4a70-89e3-14fa5855f923', 'bbf3bc8b-4400-4ce6-90d0-49fa84dd4b35', '8823738f-512d-4799-9840-50c286f1d28e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:23:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Delete snapshot completed successfully.
Nov 05 04:23:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6c082aaf-41fd-4b19-ad06-d2c475c020ec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-7a62aee2-cef9-4cb4-b8c6-226721a0608f-delete_snapshot" released by "delete_snapshot" :: held 2.674s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (9eed7ff7-4625-41a4-b281-acc5e6153866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37dff7a7-e935-4020-b3f9-7489ce2bee92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37dff7a7-e935-4020-b3f9-7489ce2bee92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-961586278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade24d03-b9b3-4bb6-b871-6f70153883d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8731f288354ba0bc7fced72468eace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:23:08Z,use_quota=True,user_id='29ebe448143d48d8ab57cf968509e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18f6480-d4ad-4373-9494-c74a98006d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18f6480-d4ad-4373-9494-c74a98006d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175cc2b5-3a51-4618-8a1c-e2650c77410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175cc2b5-3a51-4618-8a1c-e2650c77410f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ade24d03-b9b3-4bb6-b871-6f70153883d1', 'volume_name': 'volume-ade24d03-b9b3-4bb6-b871-6f70153883d1', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7702a2-2094-4737-b308-5b189d5bde1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7702a2-2094-4737-b308-5b189d5bde1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e00464b-43b5-417c-851f-268d5fb00787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:07 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Volume ade24d03-b9b3-4bb6-b871-6f70153883d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ade24d03-b9b3-4bb6-b871-6f70153883d1', 'volume_size': 1}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:23:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-961586278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade24d03-b9b3-4bb6-b871-6f70153883d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8731f288354ba0bc7fced72468eace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:23:08Z,use_quota=True,user_id='29ebe448143d48d8ab57cf968509e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Creating volume ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:23:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:23:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:23:08 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:23:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:08 devstack sudo[96981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 1073741824
Nov 05 04:23:08 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:08 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 1073741824" returned: 0 in 0.689s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:08 devstack sudo[96987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1
Nov 05 04:23:08 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:09 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.969s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:09 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Cloning volume b2452761-011b-46f7-9f81-7eb6630298b9 to volume 90fc441d-d250-4df9-ae53-88ad7cdfb73e
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e00464b-43b5-417c-851f-268d5fb00787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade24d03-b9b3-4bb6-b871-6f70153883d1', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b61a57d-0f49-41eb-be44-938312fdfa6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Volume volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 (ade24d03-b9b3-4bb6-b871-6f70153883d1): created successfully
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b61a57d-0f49-41eb-be44-938312fdfa6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (9eed7ff7-4625-41a4-b281-acc5e6153866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Creating offline snapshot b074f036-91a1-42f7-af97-56abc4d5b85b of volume b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe319f-c4f1-4b93-b0fd-088bb4be0fb0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2c0264ce-dfa4-4ceb-95e1-9ca52106a854 tempest-VolumesSnapshotTestJSON-943709473 None] Created volume successfully.
Nov 05 04:23:09 devstack sudo[96995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9
Nov 05 04:23:09 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:09 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9" returned: 0 in 0.608s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:09 devstack sudo[97012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b 1G
Nov 05 04:23:09 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:10 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b 1G" returned: 0 in 0.578s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2452761-011b-46f7-9f81-7eb6630298b9 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:10 devstack sudo[97017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2452761-011b-46f7-9f81-7eb6630298b9 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b
Nov 05 04:23:10 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:10 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2452761-011b-46f7-9f81-7eb6630298b9 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b" returned: 0 in 0.337s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:10 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:23:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:10 devstack sudo[97022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b
Nov 05 04:23:10 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:11 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b" returned: 0 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:11 devstack sudo[97025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.info
Nov 05 04:23:11 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:11 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.info" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:11 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:11 devstack sudo[97030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.info
Nov 05 04:23:11 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:11 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.info" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Acquiring lock "cinder-quobyte-90fc441d-d250-4df9-ae53-88ad7cdfb73e" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Lock "cinder-quobyte-90fc441d-d250-4df9-ae53-88ad7cdfb73e" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] snapshot: b074f036-91a1-42f7-af97-56abc4d5b85b, volume: 90fc441d-d250-4df9-ae53-88ad7cdfb73e,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b2b39f-0b9d-412d-a78d-9c34b586f3b3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:12 devstack sudo[97035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b
Nov 05 04:23:12 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:12 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b" returned: 0 in 0.660s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2452761-011b-46f7-9f81-7eb6630298b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:23:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efaae0d-911f-484f-b21f-10c2f51fc754]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:12 devstack sudo[97079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9
Nov 05 04:23:12 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:13 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9" returned: 0 in 0.660s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:23:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:23:13 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:23:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:13 devstack sudo[97109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e
Nov 05 04:23:13 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30d523e3-139e-4775-9ff0-07b29ef08e98 tempest-VolumesActionsTest-2061799973 None] Acquiring lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4" by "attach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30d523e3-139e-4775-9ff0-07b29ef08e98 tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4" acquired by "attach_volume" :: waited 0.066s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-30d523e3-139e-4775-9ff0-07b29ef08e98 tempest-VolumesActionsTest-2061799973 None] Attaching volume 8ae66813-fee8-4402-bb9e-4698475d22a4 to instance c2168aac-25b5-4aeb-89b4-f6d37fb2d185 at mountpoint /dev/vdb on host None.
Nov 05 04:23:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-30d523e3-139e-4775-9ff0-07b29ef08e98 tempest-VolumesActionsTest-2061799973 None] Attach volume completed successfully.
Nov 05 04:23:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-30d523e3-139e-4775-9ff0-07b29ef08e98 tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4" released by "attach_volume" :: held 0.399s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-983c9b10-2698-4b7b-b204-b69a3d9812ab tempest-VolumesActionsTest-2061799973 None] Acquiring lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4-detach_volume" by "detach_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-983c9b10-2698-4b7b-b204-b69a3d9812ab tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4-detach_volume" acquired by "detach_volume" :: waited 0.067s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-983c9b10-2698-4b7b-b204-b69a3d9812ab tempest-VolumesActionsTest-2061799973 None] Detaching volume 8ae66813-fee8-4402-bb9e-4698475d22a4 from instance c2168aac-25b5-4aeb-89b4-f6d37fb2d185.
Nov 05 04:23:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-983c9b10-2698-4b7b-b204-b69a3d9812ab tempest-VolumesActionsTest-2061799973 None] Detach volume completed successfully.
Nov 05 04:23:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-983c9b10-2698-4b7b-b204-b69a3d9812ab tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4-detach_volume" released by "detach_volume" :: held 0.219s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e" returned: 0 in 11.736s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9, size 1024.00 MB, duration 11.74 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:23:25 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Converted 1024.00 MB image at 87.24 MB/s
Nov 05 04:23:25 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e is being set with open permissions: ugo+rw: NotImplementedError
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:25 devstack sudo[97220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e
Nov 05 04:23:25 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:25 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e" returned: 0 in 0.565s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Lock "cinder-quobyte-90fc441d-d250-4df9-ae53-88ad7cdfb73e" released by "_copy_volume_from_snapshot" :: held 13.764s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Acquiring lock "cinder-quobyte-b074f036-91a1-42f7-af97-56abc4d5b85b" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Lock "cinder-quobyte-b074f036-91a1-42f7-af97-56abc4d5b85b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Deleting offline snapshot b074f036-91a1-42f7-af97-56abc4d5b85b of volume b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] snapshot_file for this snap is: volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f50eb9-05bd-4358-b344-f474d31772d8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:26 devstack sudo[97250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b
Nov 05 04:23:26 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:26 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b" returned: 0 in 0.603s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2452761-011b-46f7-9f81-7eb6630298b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:23:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b940449e-d63a-4893-b910-9db78fd6549e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:26 devstack sudo[97274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9
Nov 05 04:23:26 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:27 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9" returned: 0 in 0.892s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:27 devstack sudo[97301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b
Nov 05 04:23:27 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:27 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b" returned: 0 in 0.396s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:27 devstack sudo[97307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b
Nov 05 04:23:27 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:28 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9.b074f036-91a1-42f7-af97-56abc4d5b85b" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Lock "cinder-quobyte-b074f036-91a1-42f7-af97-56abc4d5b85b" released by "_delete_snapshot" :: held 2.478s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.094s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.028s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Creating offline snapshot 76422eb4-40eb-4c2f-9e74-414d6d6d959e of volume ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:23:28 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49ecb2f-31d3-469a-b5c0-385e187a60c1]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6d23cb04-1d0f-4c29-a3e5-9bdfb80058a4 tempest-GroupsV314Test-738098540 None] Create group from source-group-9e77675f-6b8f-4f0f-9668-3ac798c6d073 completed successfully.
Nov 05 04:23:28 devstack sudo[97310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1
Nov 05 04:23:28 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:28 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:28 devstack sudo[97316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e 1G
Nov 05 04:23:28 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:29 devstack sudo[97322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:23:29 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:29 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e 1G" returned: 0 in 0.675s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:29 devstack sudo[97325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e
Nov 05 04:23:29 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:29 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.568s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:23:29 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e" returned: 0 in 0.433s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:29 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e is being set with open permissions: ugo+rw
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:29 devstack sudo[97332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e
Nov 05 04:23:29 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Acquiring lock "cinder-quobyte-90fc441d-d250-4df9-ae53-88ad7cdfb73e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Lock "cinder-quobyte-90fc441d-d250-4df9-ae53-88ad7cdfb73e" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[12249386-7ba7-483e-8a6c-2ef383ab3d5e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:30 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e" returned: 0 in 0.326s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:30 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e
Nov 05 04:23:30 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:30 devstack sudo[97336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.info
Nov 05 04:23:30 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:30 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.info" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:30 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.info is being set with open permissions: ugo+rw
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:30 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:30 devstack sudo[97343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.info
Nov 05 04:23:30 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:30 devstack sudo[97344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e
Nov 05 04:23:30 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:30 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.info" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb5286-225e-4e68-b45b-06638fe176f8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:30 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-714a1a3e-a850-47a9-8c0a-d8dc8eb41f3d tempest-VolumesSnapshotTestJSON-943709473 None] Create snapshot completed successfully
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-90fc441d-d250-4df9-ae53-88ad7cdfb73e" returned: 0 in 0.347s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Lock "cinder-quobyte-90fc441d-d250-4df9-ae53-88ad7cdfb73e" released by "delete_volume" :: held 0.898s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Created reservations ['e488a9a5-4e5b-418d-a5f1-2c9b56d62461'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:23:30 devstack sudo[97349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4
Nov 05 04:23:30 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:30 devstack cinder-volume[87166]: WARNING cinder.quota [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-647196110 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-647196110, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:23:30 devstack cinder-volume[87166]: WARNING cinder.quota [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-647196110 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-647196110, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:23:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Created reservations ['127a8583-8f39-4a8f-8dea-2fd13973b82d', '81c531c5-5418-43c4-93e7-2471ca7ee87d', 'f6a43ebc-e46d-469b-b627-cbb0a5313de1', '274bf08f-635a-44f6-b7dc-fe997ab93e30'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:31 devstack sudo[97351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:23:31 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:31 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4" returned: 0 in 0.457s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e56961a-fa98-482b-a78d-6d3217bdcef8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:31 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.308s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:23:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c39f96fa-f577-447e-bba9-b07a3a918a52 tempest-GroupsV314Test-738098540 None] Delete group completed successfully.
Nov 05 04:23:31 devstack sudo[97357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4
Nov 05 04:23:31 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Acquiring lock "cinder-quobyte-b2452761-011b-46f7-9f81-7eb6630298b9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Lock "cinder-quobyte-b2452761-011b-46f7-9f81-7eb6630298b9" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[20555d2b-c152-47ef-a84e-f2a110f73164]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:31 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4" returned: 0 in 0.599s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.edf1108f-3078-42fa-9bb2-142303ee5f0e866mfuwr.img {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:31 devstack sudo[97360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9
Nov 05 04:23:31 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:31 devstack sudo[97364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.edf1108f-3078-42fa-9bb2-142303ee5f0e866mfuwr.img
Nov 05 04:23:31 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:32 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9" returned: 0 in 0.513s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:32 devstack sudo[97377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9
Nov 05 04:23:32 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (769670b8-7b42-4fe3-b424-76393d635d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73de1dc-a72f-4386-8243-7a9ee2190192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c73de1dc-a72f-4386-8243-7a9ee2190192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-432409392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84dda55e-2fc3-4e49-9dc8-d59baa0220d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8731f288354ba0bc7fced72468eace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:23:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=76422eb4-40eb-4c2f-9e74-414d6d6d959e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:23:32Z,use_quota=True,user_id='29ebe448143d48d8ab57cf968509e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcc5548-e0dd-401a-b996-bfa5ba54d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcc5548-e0dd-401a-b996-bfa5ba54d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:32 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03c27bb-12e7-47c5-ac24-3dfc47ba3fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03c27bb-12e7-47c5-ac24-3dfc47ba3fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84dda55e-2fc3-4e49-9dc8-d59baa0220d8', 'volume_name': 'volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8', 'volume_size': 2, 'snapshot_id': '76422eb4-40eb-4c2f-9e74-414d6d6d959e'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249a53ef-9a86-47f5-8798-b439e1086a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (249a53ef-9a86-47f5-8798-b439e1086a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33331e44-897c-4dff-b4e7-0cd8dbbbe686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:32 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Volume 84dda55e-2fc3-4e49-9dc8-d59baa0220d8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8', 'volume_size': 2, 'snapshot_id': '76422eb4-40eb-4c2f-9e74-414d6d6d959e'}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b2452761-011b-46f7-9f81-7eb6630298b9" returned: 0 in 0.530s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Lock "cinder-quobyte-b2452761-011b-46f7-9f81-7eb6630298b9" released by "delete_volume" :: held 1.230s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Created reservations ['e8e14775-d58a-40c5-b09c-2d5390fc514e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Created reservations ['95ef7232-c27e-4ee5-b15e-f256483959ab', '6e8d3c59-6a4c-4d1a-a3b5-79203a2c0b76', '966b026b-cff8-4e75-9c3e-c5dd62fccc0e', '354e56f2-c4ca-45d4-9fb5-3d6f86dc5b1c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:33 devstack sudo[97383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:23:33 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:33 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.467s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:33 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:23:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-97330727-6031-4419-9a96-190f4dfd6632 tempest-GroupsV314Test-738098540 None] Delete group completed successfully.
Nov 05 04:23:40 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.edf1108f-3078-42fa-9bb2-142303ee5f0e866mfuwr.img" returned: 0 in 8.628s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2565f298-63b5-4b15-91a9-0dd620e3ca89]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:23:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:23:40 devstack sudo[97420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4
Nov 05 04:23:40 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:23:41 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root
Nov 05 04:23:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4" returned: 0 in 0.541s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:23:41 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4, size 1024.00 MB, duration 8.63 sec, destination /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.edf1108f-3078-42fa-9bb2-142303ee5f0e866mfuwr.img {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:23:41 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Converted 1024.00 MB image at 118.63 MB/s
Nov 05 04:23:41 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] edf1108f-3078-42fa-9bb2-142303ee5f0e was raw, no need to convert to raw {{(pid=87166) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 04:23:49 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:23:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Flow 'volume_create_manager' (31ebeef7-ef05-45ce-bd20-d451a1ccbdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:23:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed35fa87-8947-4fd7-9a94-c82165874122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed35fa87-8947-4fd7-9a94-c82165874122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-921797459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7174931c-7826-456a-9d94-0a6edb28865a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754658bcba164092b99a8c40e0767c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:23:50Z,use_quota=True,user_id='485b3dc51b1240f686b8c8e93e8b993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b57c8b7-dcc0-4a37-8025-c08b3816e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b57c8b7-dcc0-4a37-8025-c08b3816e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2967c048-4682-438e-af90-06ef4ae966af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2967c048-4682-438e-af90-06ef4ae966af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7174931c-7826-456a-9d94-0a6edb28865a', 'volume_name': 'volume-7174931c-7826-456a-9d94-0a6edb28865a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df5d808-053e-4392-b785-f283e99e0bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df5d808-053e-4392-b785-f283e99e0bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed98a6c-c162-4525-9f55-21904f0f6176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:50 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Volume 7174931c-7826-456a-9d94-0a6edb28865a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7174931c-7826-456a-9d94-0a6edb28865a', 'volume_size': 1}
Nov 05 04:23:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Flow 'volume_create_manager' (d41d946b-596c-44cd-af22-a59c9314ae2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e906abc-d550-4b7a-afbb-3ee50566d0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e906abc-d550-4b7a-afbb-3ee50566d0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-990603231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6f9750-fd59-41ad-bd92-cd8e08f244d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3b498dc7b54a5980d8bf04c8e4e581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:23:51Z,use_quota=True,user_id='f1b552f5fdc44954a16d7bd8439e4a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6eb60d4-cf74-4c55-9504-061089e3e2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6eb60d4-cf74-4c55-9504-061089e3e2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce531db6-bc35-4659-912f-8b79669dd5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce531db6-bc35-4659-912f-8b79669dd5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce6f9750-fd59-41ad-bd92-cd8e08f244d9', 'volume_name': 'volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de766ecf-fc52-4463-8363-f4bf4c539043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de766ecf-fc52-4463-8363-f4bf4c539043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f01e6a-2d96-4301-b2eb-2a6a03c15e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:23:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Volume ce6f9750-fd59-41ad-bd92-cd8e08f244d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9', 'volume_size': 1}
Nov 05 04:23:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=70,cinder:UPDATE=46,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=67,cinder:UPDATE=57,cinder:DELETE=3,cinder:INSERT=16 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.510s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Uploaded volume to glance image-id: edf1108f-3078-42fa-9bb2-142303ee5f0e. {{(pid=87166) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 28.447s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-76422eb4-40eb-4c2f-9e74-414d6d6d959e-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-27b91fe2-2835-4ee9-a85c-9d4d936733ac tempest-VolumesActionsTest-2061799973 None] Copy volume to image completed successfully.
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-76422eb4-40eb-4c2f-9e74-414d6d6d959e-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Creating volume 84dda55e-2fc3-4e49-9dc8-d59baa0220d8 from snapshot 76422eb4-40eb-4c2f-9e74-414d6d6d959e {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] snapshot: 76422eb4-40eb-4c2f-9e74-414d6d6d959e, volume: 84dda55e-2fc3-4e49-9dc8-d59baa0220d8,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e95af6c-221d-45b4-adac-58900adf489c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:01 devstack sudo[97430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e
Nov 05 04:24:01 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:01 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ade24d03-b9b3-4bb6-b871-6f70153883d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6ba8f4-7e92-45ac-8301-ab210e75df6a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:01 devstack sudo[97435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1
Nov 05 04:24:01 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:02 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:24:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:24:02 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:24:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:02 devstack sudo[97440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8
Nov 05 04:24:02 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:08 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" returned: 0 in 6.235s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:24:08 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Converted 1024.00 MB image at 164.20 MB/s
Nov 05 04:24:08 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8 is being set with open permissions: ugo+rw
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:08 devstack sudo[97453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8
Nov 05 04:24:08 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:08 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" returned: 0 in 0.234s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" released by "_copy_volume_from_snapshot" :: held 7.268s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-76422eb4-40eb-4c2f-9e74-414d6d6d959e-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" released by "_create_volume_from_snapshot" :: held 7.327s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.352s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.607s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-921797459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7174931c-7826-456a-9d94-0a6edb28865a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754658bcba164092b99a8c40e0767c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:23:50Z,use_quota=True,user_id='485b3dc51b1240f686b8c8e93e8b993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Creating volume 7174931c-7826-456a-9d94-0a6edb28865a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:08 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:08 devstack sudo[97456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a 1073741824
Nov 05 04:24:08 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33331e44-897c-4dff-b4e7-0cd8dbbbe686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8', 'volume_size': 2, 'snapshot_id': '76422eb4-40eb-4c2f-9e74-414d6d6d959e'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892e51f7-7c18-43e3-a1f7-7ad80e5e1547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Volume volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8 (84dda55e-2fc3-4e49-9dc8-d59baa0220d8): created successfully
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892e51f7-7c18-43e3-a1f7-7ad80e5e1547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (769670b8-7b42-4fe3-b424-76393d635d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b8dbcd8b-5feb-406f-a5ea-db339190df6c tempest-VolumesSnapshotTestJSON-943709473 None] Created volume successfully.
Nov 05 04:24:09 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a 1073741824" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:09 devstack sudo[97462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a
Nov 05 04:24:09 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:09 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.214s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-990603231',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce6f9750-fd59-41ad-bd92-cd8e08f244d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3b498dc7b54a5980d8bf04c8e4e581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:23:51Z,use_quota=True,user_id='f1b552f5fdc44954a16d7bd8439e4a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Creating volume ce6f9750-fd59-41ad-bd92-cd8e08f244d9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:09 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed98a6c-c162-4525-9f55-21904f0f6176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7174931c-7826-456a-9d94-0a6edb28865a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e1869c-5399-4fbc-9825-ca55eacd3b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:09 devstack sudo[97466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9 1073741824
Nov 05 04:24:09 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Volume volume-7174931c-7826-456a-9d94-0a6edb28865a (7174931c-7826-456a-9d94-0a6edb28865a): created successfully
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e1869c-5399-4fbc-9825-ca55eacd3b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Flow 'volume_create_manager' (31ebeef7-ef05-45ce-bd20-d451a1ccbdea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-14be44e5-1c12-4f6d-b851-a47f480c5e66 tempest-AttachVolumeNegativeTest-1975972844 None] Created volume successfully.
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-84dda55e-2fc3-4e49-9dc8-d59baa0220d8-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-84dda55e-2fc3-4e49-9dc8-d59baa0220d8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ad4794-9cf2-4bee-8c4c-34db1bb5af02]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:09 devstack sudo[97468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8
Nov 05 04:24:09 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:09 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9 1073741824" returned: 0 in 0.428s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:09 devstack sudo[97474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9
Nov 05 04:24:09 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:09 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:09 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8
Nov 05 04:24:09 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:10 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 6.110s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f01e6a-2d96-4301-b2eb-2a6a03c15e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b40021-b4ab-43ad-8c83-f086f49284b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7d9c7a-e487-4458-bb64-29ef19ccc952]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Volume volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9 (ce6f9750-fd59-41ad-bd92-cd8e08f244d9): created successfully
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b40021-b4ab-43ad-8c83-f086f49284b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Flow 'volume_create_manager' (d41d946b-596c-44cd-af22-a59c9314ae2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ddebaf86-6eca-44cb-9a2c-76dabe53e03e tempest-VolumesListAdminTestJSON-1179468838 None] Created volume successfully.
Nov 05 04:24:10 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-84dda55e-2fc3-4e49-9dc8-d59baa0220d8" released by "delete_volume" :: held 0.701s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:10 devstack sudo[97482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4
Nov 05 04:24:10 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Created reservations ['74774e6e-cd84-4124-a61e-f9683c375c7c', '01d11d42-2989-4426-8c88-33fd366ddafc', 'cc97d799-d0a0-40a4-baac-70e7bf5d07d5', '849dc560-71d8-44f3-8116-d0b35c6c58b9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:10 devstack sudo[97488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:10 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:10 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4" returned: 0 in 0.486s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1a0c38-134b-4e1b-ac99-27cd75aff69f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:10 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Deleted volume successfully.
Nov 05 04:24:10 devstack sudo[97493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4
Nov 05 04:24:10 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d5ef72c2-c89e-4271-9650-e402836b6ab8 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-84dda55e-2fc3-4e49-9dc8-d59baa0220d8-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-76422eb4-40eb-4c2f-9e74-414d6d6d959e-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-76422eb4-40eb-4c2f-9e74-414d6d6d959e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-ade24d03-b9b3-4bb6-b871-6f70153883d1" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-ade24d03-b9b3-4bb6-b871-6f70153883d1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-76422eb4-40eb-4c2f-9e74-414d6d6d959e" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:24:11 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Flow 'volume_create_manager' (3b72a506-2ee6-4f5e-8281-72c735ee9443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ebe348-8660-42e0-97be-16f195cb17fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-76422eb4-40eb-4c2f-9e74-414d6d6d959e" acquired by "_delete_snapshot" :: waited 0.076s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Deleting offline snapshot 76422eb4-40eb-4c2f-9e74-414d6d6d959e of volume ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] snapshot_file for this snap is: volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4" returned: 0 in 0.548s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b335f6a6-5a27-424f-9821-3b63e16bf536]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:11 devstack sudo[97507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img
Nov 05 04:24:11 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41ebe348-8660-42e0-97be-16f195cb17fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-632614877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c09ef58-7ee2-4785-a2c4-317d70c78490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3b498dc7b54a5980d8bf04c8e4e581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:11Z,use_quota=True,user_id='f1b552f5fdc44954a16d7bd8439e4a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964faab6-74ae-4f2c-96ee-3fcea1ab0767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964faab6-74ae-4f2c-96ee-3fcea1ab0767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8253595-ba4a-474e-9e31-077bd694b503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8253595-ba4a-474e-9e31-077bd694b503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c09ef58-7ee2-4785-a2c4-317d70c78490', 'volume_name': 'volume-4c09ef58-7ee2-4785-a2c4-317d70c78490', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e82a68-711f-4fdf-b4d6-bbaec8adb620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30e82a68-711f-4fdf-b4d6-bbaec8adb620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33226fdd-3754-45f8-8f57-010c77822cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Volume 4c09ef58-7ee2-4785-a2c4-317d70c78490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c09ef58-7ee2-4785-a2c4-317d70c78490', 'volume_size': 1}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:11 devstack sudo[97508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e
Nov 05 04:24:11 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-c386192d-721c-4877-b872-8eaaf9a21cc0 req-0037e3e1-7d82-4262-b379-1db546db6a6c tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:11 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e" returned: 0 in 0.454s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ade24d03-b9b3-4bb6-b871-6f70153883d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e94de6-f018-41bc-88ff-216c68f2f9a1]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:11 devstack sudo[97525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1
Nov 05 04:24:11 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:12 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1" returned: 0 in 0.839s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:12 devstack sudo[97530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e
Nov 05 04:24:12 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:13 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e" returned: 0 in 0.591s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:13 devstack sudo[97536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e
Nov 05 04:24:13 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:13 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1.76422eb4-40eb-4c2f-9e74-414d6d6d959e" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-76422eb4-40eb-4c2f-9e74-414d6d6d959e" released by "_delete_snapshot" :: held 2.460s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-ade24d03-b9b3-4bb6-b871-6f70153883d1" released by "delete_snapshot" :: held 2.554s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:13 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Created reservations ['426eab9c-6269-41a3-9e81-421c2351d5e3', 'faa13d59-857f-4e8d-9fdb-58656ae4a782', '56d91d54-a6d4-4038-bb28-bc1e1b303275', 'f05a3784-4057-469e-82f3-3e8173621683'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Delete snapshot completed successfully.
Nov 05 04:24:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a640bebe-c338-492b-a30f-a02bdc6c3a43 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-76422eb4-40eb-4c2f-9e74-414d6d6d959e-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-ade24d03-b9b3-4bb6-b871-6f70153883d1-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-ade24d03-b9b3-4bb6-b871-6f70153883d1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-ade24d03-b9b3-4bb6-b871-6f70153883d1" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-ade24d03-b9b3-4bb6-b871-6f70153883d1" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f17401-05a8-40dc-802b-7276401527a0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:14 devstack sudo[97541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1
Nov 05 04:24:14 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:15 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1" returned: 0 in 0.679s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:15 devstack sudo[97546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1
Nov 05 04:24:15 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:15 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ade24d03-b9b3-4bb6-b871-6f70153883d1" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-ade24d03-b9b3-4bb6-b871-6f70153883d1" released by "delete_volume" :: held 1.228s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Created reservations ['f49529f0-b363-4b2d-a5ba-311581f0b517', 'bc0bdc77-35f5-4a03-80f7-77552f6e69a6', '78bca880-9fc8-4a40-bd87-aa29d855f292', 'ecc155f8-926e-44a2-86cd-dbee7a9b365c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:16 devstack sudo[97549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:16 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:16 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.578s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Deleted volume successfully.
Nov 05 04:24:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-031871f0-ea93-409a-9adb-be28fbe54a06 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-ade24d03-b9b3-4bb6-b871-6f70153883d1-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:17 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (65de4d58-50e5-4c03-b36d-a228596ce8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4135a7-9e8e-4b2a-8dc6-092c99ab7b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4135a7-9e8e-4b2a-8dc6-092c99ab7b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1113576959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8731f288354ba0bc7fced72468eace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:18Z,use_quota=True,user_id='29ebe448143d48d8ab57cf968509e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7e672c-f2be-4052-82c9-35f927ed5677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7e672c-f2be-4052-82c9-35f927ed5677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f0d96b-b1cd-4ddf-b28e-dfdface2f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f0d96b-b1cd-4ddf-b28e-dfdface2f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f', 'volume_name': 'volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42d6865-2883-4f63-8789-e448c38981ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42d6865-2883-4f63-8789-e448c38981ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5893f036-3fe4-4bd8-a6f8-a0a6824ad9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Volume ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f', 'volume_size': 1}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:18 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img" returned: 0 in 6.985s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[77adfa9d-0526-42d0-b865-db156bfe95b7]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:18 devstack sudo[97558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4
Nov 05 04:24:18 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:18 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4" returned: 0 in 0.544s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:24:18 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Converted 1024.00 MB image at 146.58 MB/s
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] 7155c45d-90c4-4b83-9eda-6584e0538c7f was raw, converting to qcow2 {{(pid=87166) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e9e8e2-b644-431e-9311-f4b384738416]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:18 devstack sudo[97563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img
Nov 05 04:24:18 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:19 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:19 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img
Nov 05 04:24:19 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:19 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img" returned: 1 in 0.315s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img /opt/stack/data/cinder/conversion/vol_upload_tp8ot0ra {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:19 devstack sudo[97573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img /opt/stack/data/cinder/conversion/vol_upload_tp8ot0ra
Nov 05 04:24:19 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:19 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img /opt/stack/data/cinder/conversion/vol_upload_tp8ot0ra" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Image conversion details: src /opt/stack/data/cinder/conversion/8ae66813-fee8-4402-bb9e-4698475d22a4.temp_image.7155c45d-90c4-4b83-9eda-6584e0538c7fnifmt2jn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_tp8ot0ra {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:24:19 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ac30d7-eb11-4a8f-876e-d1f890cdbe0a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tp8ot0ra {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:19 devstack sudo[97578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tp8ot0ra
Nov 05 04:24:19 devstack sudo[97578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:19 devstack sudo[97578]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_tp8ot0ra" returned: 0 in 0.316s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.131s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Uploaded volume to glance image-id: 7155c45d-90c4-4b83-9eda-6584e0538c7f. {{(pid=87166) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.962s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-632614877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c09ef58-7ee2-4785-a2c4-317d70c78490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3b498dc7b54a5980d8bf04c8e4e581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:11Z,use_quota=True,user_id='f1b552f5fdc44954a16d7bd8439e4a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Creating volume 4c09ef58-7ee2-4785-a2c4-317d70c78490 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:21 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:21 devstack sudo[97584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490 1073741824
Nov 05 04:24:21 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b591d16c-ecb0-4af1-b2eb-f6ea62e41061 tempest-VolumesActionsTest-2061799973 None] Copy volume to image completed successfully.
Nov 05 04:24:21 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490 1073741824" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:21 devstack sudo[97594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490
Nov 05 04:24:21 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:21 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-c386192d-721c-4877-b872-8eaaf9a21cc0 req-0037e3e1-7d82-4262-b379-1db546db6a6c tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.628s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33226fdd-3754-45f8-8f57-010c77822cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c09ef58-7ee2-4785-a2c4-317d70c78490', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7611ebf-e7bd-4b29-a98d-13f26b8d615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-c386192d-721c-4877-b872-8eaaf9a21cc0 req-0037e3e1-7d82-4262-b379-1db546db6a6c tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.936s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1113576959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8731f288354ba0bc7fced72468eace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:18Z,use_quota=True,user_id='29ebe448143d48d8ab57cf968509e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Creating volume ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:22 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Volume volume-4c09ef58-7ee2-4785-a2c4-317d70c78490 (4c09ef58-7ee2-4785-a2c4-317d70c78490): created successfully
Nov 05 04:24:22 devstack sudo[97600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f 1073741824
Nov 05 04:24:22 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7611ebf-e7bd-4b29-a98d-13f26b8d615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Flow 'volume_create_manager' (3b72a506-2ee6-4f5e-8281-72c735ee9443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-330b315b-b7d1-42ec-a7da-998d8f647129 tempest-VolumesListAdminTestJSON-1179468838 None] Created volume successfully.
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-c386192d-721c-4877-b872-8eaaf9a21cc0 req-0037e3e1-7d82-4262-b379-1db546db6a6c tempest-AttachVolumeNegativeTest-1975972844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-7174931c-7826-456a-9d94-0a6edb28865a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59788213-466b-4d92-9c19-af61f1310977', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:24:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-c386192d-721c-4877-b872-8eaaf9a21cc0 req-0037e3e1-7d82-4262-b379-1db546db6a6c tempest-AttachVolumeNegativeTest-1975972844 None] attachment_update completed successfully.
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Acquiring lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Acquiring lock "cinder-quobyte-8ae66813-fee8-4402-bb9e-4698475d22a4" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Lock "cinder-quobyte-8ae66813-fee8-4402-bb9e-4698475d22a4" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:22 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f 1073741824" returned: 0 in 0.636s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e83443-0d90-4cea-99db-d5d34d6bb32a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:22 devstack sudo[98024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f
Nov 05 04:24:22 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:22 devstack sudo[98022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4
Nov 05 04:24:22 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:23 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" returned: 0 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5893f036-3fe4-4bd8-a6f8-a0a6824ad9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777f3525-305b-43eb-98ee-67aee54f52a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Volume volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f (ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f): created successfully
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777f3525-305b-43eb-98ee-67aee54f52a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (65de4d58-50e5-4c03-b36d-a228596ce8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-77d6e766-af32-403c-9feb-50ab70b48710 tempest-VolumesSnapshotTestJSON-943709473 None] Created volume successfully.
Nov 05 04:24:23 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4" returned: 0 in 0.471s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:23 devstack sudo[98033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4
Nov 05 04:24:23 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:23 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8ae66813-fee8-4402-bb9e-4698475d22a4" returned: 0 in 0.324s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Lock "cinder-quobyte-8ae66813-fee8-4402-bb9e-4698475d22a4" released by "delete_volume" :: held 0.845s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Created reservations ['ba3b81a3-cc11-479e-b268-1aece1a37708', 'd66d8284-3962-4f7d-b2a7-35fb2393c7da', 'adc711cd-e128-495d-96fc-458b3ef9f1ba', 'c4f4ce10-0fd2-4894-8df9-34718260dec2'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:23 devstack sudo[98036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:23 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Flow 'volume_create_manager' (c24d991f-d0fd-468a-9a4a-b9a8a38daf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be8ae9b-420f-4828-90a0-ad4cc8f4a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be8ae9b-420f-4828-90a0-ad4cc8f4a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2032786738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e6aa5d-aa40-4e78-aae6-6b4bf501cd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3b498dc7b54a5980d8bf04c8e4e581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:24Z,use_quota=True,user_id='f1b552f5fdc44954a16d7bd8439e4a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd78faf8-36e8-4ea4-921d-c87e66906200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd78faf8-36e8-4ea4-921d-c87e66906200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c81f83-44cb-4543-825c-fd9cf4a9ac6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c81f83-44cb-4543-825c-fd9cf4a9ac6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e6aa5d-aa40-4e78-aae6-6b4bf501cd32', 'volume_name': 'volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81f1a26-a078-4d13-9637-888b589d71b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d81f1a26-a078-4d13-9637-888b589d71b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1f5ff3-77ae-4201-84f3-40bcc0222c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Volume 30e6aa5d-aa40-4e78-aae6-6b4bf501cd32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32', 'volume_size': 1}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2032786738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e6aa5d-aa40-4e78-aae6-6b4bf501cd32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da3b498dc7b54a5980d8bf04c8e4e581',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:24Z,use_quota=True,user_id='f1b552f5fdc44954a16d7bd8439e4a43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Creating volume 30e6aa5d-aa40-4e78-aae6-6b4bf501cd32 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:23 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:23 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.316s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:23 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Deleted volume successfully.
Nov 05 04:24:23 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32 1073741824
Nov 05 04:24:23 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e94c6e0-0a37-4d01-bd70-fdaa7713abfc tempest-VolumesActionsTest-2061799973 None] Lock "cinder-8ae66813-fee8-4402-bb9e-4698475d22a4-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-472ebbd7-4ad8-4210-8eb7-05c9b15ecbcf req-74af4034-9ffc-436b-84fe-a98f469b1c5b tempest-AttachVolumeNegativeTest-1975972844 None] Terminate volume connection completed successfully.
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-472ebbd7-4ad8-4210-8eb7-05c9b15ecbcf req-74af4034-9ffc-436b-84fe-a98f469b1c5b tempest-AttachVolumeNegativeTest-1975972844 None] Deleting attachment 59788213-466b-4d92-9c19-af61f1310977. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:24 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32 1073741824" returned: 0 in 0.628s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:24 devstack sudo[98071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32
Nov 05 04:24:24 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:24 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.369s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Creating offline snapshot d6f054cf-74e8-4fb0-ba29-37ebfb66d492 of volume ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1f5ff3-77ae-4201-84f3-40bcc0222c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81af970-cf36-4b50-bfc6-a47cd5e8229f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25bb115-4b86-41f3-a7fd-82715aaafef8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Volume volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32 (30e6aa5d-aa40-4e78-aae6-6b4bf501cd32): created successfully
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81af970-cf36-4b50-bfc6-a47cd5e8229f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Flow 'volume_create_manager' (c24d991f-d0fd-468a-9a4a-b9a8a38daf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d3306fe8-cbfe-4920-b024-6d93d999133e tempest-VolumesListAdminTestJSON-1179468838 None] Created volume successfully.
Nov 05 04:24:25 devstack sudo[98075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f
Nov 05 04:24:25 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:25 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:25 devstack sudo[98080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 1G
Nov 05 04:24:25 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:26 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 1G" returned: 0 in 0.742s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:26 devstack sudo[98106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492
Nov 05 04:24:26 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:26 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492" returned: 0 in 0.454s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:26 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 is being set with open permissions: ugo+rw
Nov 05 04:24:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:26 devstack sudo[98113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492
Nov 05 04:24:26 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:26 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:24:26 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Flow 'volume_create_manager' (a0133ff4-12fa-43d0-9d51-2eb5907300ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8b280e-05cb-451a-adb1-ee4f014659d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492" returned: 0 in 0.469s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8b280e-05cb-451a-adb1-ee4f014659d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318b10e7f9d4e7a8d95118530c24fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:27Z,use_quota=True,user_id='a139fd9a71734462b7a6bd63e499e7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9845739c-8e2d-4783-bbfa-37a5b9683f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9845739c-8e2d-4783-bbfa-37a5b9683f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3d2674-02b6-49a1-ba98-9bad0fe12725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3d2674-02b6-49a1-ba98-9bad0fe12725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0', 'volume_name': 'volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21875bc-823d-4ae9-95c2-70edc0d91ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21875bc-823d-4ae9-95c2-70edc0d91ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30546510-55a7-4301-b7fc-f94ddbdcdd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Volume dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0', 'volume_size': 1}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:27 devstack sudo[98118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.info
Nov 05 04:24:27 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:27 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.info" returned: 0 in 0.275s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:27 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.info is being set with open permissions: ugo+rw
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:27 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.info
Nov 05 04:24:27 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:27 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.info" returned: 0 in 0.291s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318b10e7f9d4e7a8d95118530c24fe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:27Z,use_quota=True,user_id='a139fd9a71734462b7a6bd63e499e7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Creating volume dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:27 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:24:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:27 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0 1073741824
Nov 05 04:24:27 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-aaa7250c-a8c9-49df-be0d-3631e6c83abb tempest-VolumesSnapshotTestJSON-943709473 None] Create snapshot completed successfully
Nov 05 04:24:28 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0 1073741824" returned: 0 in 0.439s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:28 devstack sudo[98166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0
Nov 05 04:24:28 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:28 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:24:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30546510-55a7-4301-b7fc-f94ddbdcdd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18cc22d-d4d1-4405-8862-aadfe135963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Volume volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0 (dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0): created successfully
Nov 05 04:24:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18cc22d-d4d1-4405-8862-aadfe135963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Flow 'volume_create_manager' (a0133ff4-12fa-43d0-9d51-2eb5907300ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ba4e8fc3-b23c-4377-bc11-82d9010ea714 tempest-VolumesListAdminTestJSON-1718385146 None] Created volume successfully.
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:29 devstack sudo[98170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:29 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Acquiring lock "cinder-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "cinder-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Acquiring lock "cinder-quobyte-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "cinder-quobyte-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0" acquired by "delete_volume" :: waited 0.048s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "cinder-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[027713bf-69a3-41bd-87c2-9d6aadd6fdb3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "cinder-quobyte-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-quobyte-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:29 devstack sudo[98173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0
Nov 05 04:24:29 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea17b20-5d30-4e89-9cd1-70e1ed4fc124]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (e0d774c1-e9bf-45ab-8ec3-42eb807d4168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e2111e-5550-4190-9a0f-5ee04e4df5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:29 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.644s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e2111e-5550-4190-9a0f-5ee04e4df5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1387867890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64763015-436e-4c7f-8202-c430c7234e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b8731f288354ba0bc7fced72468eace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d6f054cf-74e8-4fb0-ba29-37ebfb66d492,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:30Z,use_quota=True,user_id='29ebe448143d48d8ab57cf968509e020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a055cb-522d-45f1-a1d4-0b1d9d66fd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a055cb-522d-45f1-a1d4-0b1d9d66fd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3b2a0c-4b59-4bf5-8595-6d9b2fb4be2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:29 devstack sudo[98176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32
Nov 05 04:24:29 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3b2a0c-4b59-4bf5-8595-6d9b2fb4be2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '64763015-436e-4c7f-8202-c430c7234e21', 'volume_name': 'volume-64763015-436e-4c7f-8202-c430c7234e21', 'volume_size': 1, 'snapshot_id': 'd6f054cf-74e8-4fb0-ba29-37ebfb66d492'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6a1c52-aeee-4d5c-9c5b-07ba5677c313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b6a1c52-aeee-4d5c-9c5b-07ba5677c313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e684067d-ed18-479a-b219-d38a8bb4929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Volume 64763015-436e-4c7f-8202-c430c7234e21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-64763015-436e-4c7f-8202-c430c7234e21', 'volume_size': 1, 'snapshot_id': 'd6f054cf-74e8-4fb0-ba29-37ebfb66d492'}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-d6f054cf-74e8-4fb0-ba29-37ebfb66d492-64763015-436e-4c7f-8202-c430c7234e21" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-d6f054cf-74e8-4fb0-ba29-37ebfb66d492-64763015-436e-4c7f-8202-c430c7234e21" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Creating volume 64763015-436e-4c7f-8202-c430c7234e21 from snapshot d6f054cf-74e8-4fb0-ba29-37ebfb66d492 {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-64763015-436e-4c7f-8202-c430c7234e21" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-64763015-436e-4c7f-8202-c430c7234e21" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] snapshot: d6f054cf-74e8-4fb0-ba29-37ebfb66d492, volume: 64763015-436e-4c7f-8202-c430c7234e21,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:24:29 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0" returned: 0 in 0.574s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bab275-b174-459f-bd82-ba8a872164f8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:29 devstack sudo[98182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0
Nov 05 04:24:29 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:30 devstack sudo[98184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492
Nov 05 04:24:30 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:30 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32" returned: 0 in 0.601s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:30 devstack sudo[98189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32
Nov 05 04:24:30 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:30 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0" returned: 0 in 0.500s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "cinder-quobyte-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0" released by "delete_volume" :: held 1.173s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:30 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32" returned: 0 in 0.351s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:30 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492" returned: 0 in 0.606s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-quobyte-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32" released by "delete_volume" :: held 1.060s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f496bfc2-e4af-43df-bacf-12b06dfd3a99]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Created reservations ['76644918-261f-4c8c-94e6-6bdd93dacc46', 'ea404830-5e92-462e-b97b-4dd110417422', 'ae28130f-dcdb-486d-8e75-40a29f11e6b3', '78fb2330-1fdd-4051-b60d-35f77601ceed'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Created reservations ['9abab683-a744-4003-95ae-08fe244d4a74', '8f51a06d-5f6b-411b-af51-18ddef4b11ed', '75c53f82-7b24-422e-a8ab-abcdea7c8d1c', '498ee952-efb9-417c-850f-a0747f07855f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:30 devstack sudo[98196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f
Nov 05 04:24:30 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:30 devstack sudo[98198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:30 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:30 devstack sudo[98200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:30 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:31 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.367s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Deleted volume successfully.
Nov 05 04:24:31 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" returned: 0 in 0.575s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:31 devstack sudo[98206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21
Nov 05 04:24:31 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a537e1f2-920f-4349-ae9a-eb2d7e295dd3 tempest-VolumesListAdminTestJSON-1718385146 None] Lock "cinder-dc8cfced-b1f3-4fc1-ad54-8be7b9a25eb0-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:31 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.440s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Deleted volume successfully.
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-334f8d12-3152-4518-b6dd-d767c693a539 tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-30e6aa5d-aa40-4e78-aae6-6b4bf501cd32-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "cinder-4c09ef58-7ee2-4785-a2c4-317d70c78490-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-4c09ef58-7ee2-4785-a2c4-317d70c78490-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "cinder-quobyte-4c09ef58-7ee2-4785-a2c4-317d70c78490" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-quobyte-4c09ef58-7ee2-4785-a2c4-317d70c78490" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[64602d78-bccb-4485-9234-b7816f34fa44]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:32 devstack sudo[98219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490
Nov 05 04:24:32 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:32 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490" returned: 0 in 0.986s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:32 devstack sudo[98224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490
Nov 05 04:24:32 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:33 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4c09ef58-7ee2-4785-a2c4-317d70c78490" returned: 0 in 0.583s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-quobyte-4c09ef58-7ee2-4785-a2c4-317d70c78490" released by "delete_volume" :: held 1.639s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Created reservations ['dbe02286-cdc4-4527-87fc-144e2fe0297d', '83747f9a-d3d1-4e7c-bf66-f4481f5c09b9', 'fca9835f-fec8-47c5-a4c2-c18a96e113f5', '5334a1fb-f8c7-4247-b823-14b7ebaf69af'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:33 devstack sudo[98228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:33 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:34 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.421s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:34 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Deleted volume successfully.
Nov 05 04:24:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a07e6d0b-f23d-4176-ab30-99b81d20b44f tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-4c09ef58-7ee2-4785-a2c4-317d70c78490-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "cinder-ce6f9750-fd59-41ad-bd92-cd8e08f244d9-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-ce6f9750-fd59-41ad-bd92-cd8e08f244d9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "cinder-quobyte-ce6f9750-fd59-41ad-bd92-cd8e08f244d9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-quobyte-ce6f9750-fd59-41ad-bd92-cd8e08f244d9" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbbb09e-4235-4a1b-b1c6-bcc701035baf]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:35 devstack sudo[98231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9
Nov 05 04:24:35 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:35 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9" returned: 0 in 0.835s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:35 devstack sudo[98236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9
Nov 05 04:24:35 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:36 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ce6f9750-fd59-41ad-bd92-cd8e08f244d9" returned: 0 in 0.507s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-quobyte-ce6f9750-fd59-41ad-bd92-cd8e08f244d9" released by "delete_volume" :: held 1.459s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Created reservations ['fa92dd4b-d6f2-452a-a3cd-c0f11be155cb', 'd043525d-a4f2-477e-a917-f89b2ef448f8', 'c2d291ba-2e1d-43a2-bffb-ce3c0d28be6d', 'd1cd9f29-888e-4fc2-b014-8b82806fd048'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:36 devstack sudo[98239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:36 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:36 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.548s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:36 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Deleted volume successfully.
Nov 05 04:24:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0ab8b47d-de9c-40cf-97d1-ffc29430b81e tempest-VolumesListAdminTestJSON-1179468838 None] Lock "cinder-ce6f9750-fd59-41ad-bd92-cd8e08f244d9-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:40 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21" returned: 0 in 9.796s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f, size 1024.00 MB, duration 9.80 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:24:41 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Converted 1024.00 MB image at 104.52 MB/s
Nov 05 04:24:41 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21 is being set with open permissions: ugo+rw
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:41 devstack sudo[98248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21
Nov 05 04:24:41 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:41 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21" returned: 0 in 0.326s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-64763015-436e-4c7f-8202-c430c7234e21" released by "_copy_volume_from_snapshot" :: held 11.450s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-d6f054cf-74e8-4fb0-ba29-37ebfb66d492-64763015-436e-4c7f-8202-c430c7234e21" released by "_create_volume_from_snapshot" :: held 11.591s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.620s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e684067d-ed18-479a-b219-d38a8bb4929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64763015-436e-4c7f-8202-c430c7234e21', 'volume_size': 1, 'snapshot_id': 'd6f054cf-74e8-4fb0-ba29-37ebfb66d492'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acc2c93-7818-4c5c-b9e3-bde544368290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Volume volume-64763015-436e-4c7f-8202-c430c7234e21 (64763015-436e-4c7f-8202-c430c7234e21): created successfully
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acc2c93-7818-4c5c-b9e3-bde544368290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Flow 'volume_create_manager' (e0d774c1-e9bf-45ab-8ec3-42eb807d4168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6be7f8c8-317c-42b5-8135-2fc322600bec tempest-VolumesSnapshotTestJSON-943709473 None] Created volume successfully.
Nov 05 04:24:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-64763015-436e-4c7f-8202-c430c7234e21-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-64763015-436e-4c7f-8202-c430c7234e21-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-64763015-436e-4c7f-8202-c430c7234e21" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-64763015-436e-4c7f-8202-c430c7234e21" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2795879-841d-474c-82ae-32a91bd0cf7d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:42 devstack sudo[98268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21
Nov 05 04:24:42 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:42 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21" returned: 0 in 0.447s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:42 devstack sudo[98273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21
Nov 05 04:24:42 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:43 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-64763015-436e-4c7f-8202-c430c7234e21" returned: 0 in 0.404s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-64763015-436e-4c7f-8202-c430c7234e21" released by "delete_volume" :: held 0.915s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Created reservations ['6ec061c2-5961-4ca9-8135-b8167db5c8b0', 'e8b67dad-c0fb-40c8-9ab0-d3bd90c60342', '54c7728c-b984-4544-9802-73e32db46e6e', '437c4096-b21f-45d1-8fa8-ea631af25444'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:43 devstack sudo[98276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:43 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Flow 'volume_create_manager' (1c626bfb-5987-41e9-add6-de8b50b2ea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045e0548-4f59-43c4-810e-42e06e752ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (045e0548-4f59-43c4-810e-42e06e752ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-436963362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff49f22-3550-4580-a92e-e9c03300fc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f4c4aead4d4e079619c3b9fcbb5bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:43Z,use_quota=True,user_id='68ca399318b441be84699669d2657c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9e24e2-9cef-45aa-85a9-1dae5b908a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9e24e2-9cef-45aa-85a9-1dae5b908a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8c502e-66f8-43b7-a451-0a57d34824de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8c502e-66f8-43b7-a451-0a57d34824de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ff49f22-3550-4580-a92e-e9c03300fc9d', 'volume_name': 'volume-3ff49f22-3550-4580-a92e-e9c03300fc9d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bedc0f0-a95d-42fb-b983-5748bd25d4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bedc0f0-a95d-42fb-b983-5748bd25d4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c06dd2e-f23e-4591-905d-ac3725308ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:43 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Volume 3ff49f22-3550-4580-a92e-e9c03300fc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ff49f22-3550-4580-a92e-e9c03300fc9d', 'volume_size': 1}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-436963362',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ff49f22-3550-4580-a92e-e9c03300fc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f4c4aead4d4e079619c3b9fcbb5bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:43Z,use_quota=True,user_id='68ca399318b441be84699669d2657c65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Creating volume 3ff49f22-3550-4580-a92e-e9c03300fc9d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:43 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:43 devstack sudo[98278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d 1073741824
Nov 05 04:24:43 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:43 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Deleted volume successfully.
Nov 05 04:24:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f3b2ed60-c020-4a31-937c-0a2169bc3a25 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-64763015-436e-4c7f-8202-c430c7234e21-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:44 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d 1073741824" returned: 0 in 0.574s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:44 devstack sudo[98286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d
Nov 05 04:24:44 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-d6f054cf-74e8-4fb0-ba29-37ebfb66d492-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-d6f054cf-74e8-4fb0-ba29-37ebfb66d492-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-d6f054cf-74e8-4fb0-ba29-37ebfb66d492" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-d6f054cf-74e8-4fb0-ba29-37ebfb66d492" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Deleting offline snapshot d6f054cf-74e8-4fb0-ba29-37ebfb66d492 of volume ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:24:44 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] snapshot_file for this snap is: volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d" returned: 0 in 0.725s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d9c527-d2f6-4e91-ba4e-bf585b0f86f2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c06dd2e-f23e-4591-905d-ac3725308ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ff49f22-3550-4580-a92e-e9c03300fc9d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeda0a80-ae08-4ffa-bcf8-d2f3adfd8318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Volume volume-3ff49f22-3550-4580-a92e-e9c03300fc9d (3ff49f22-3550-4580-a92e-e9c03300fc9d): created successfully
Nov 05 04:24:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeda0a80-ae08-4ffa-bcf8-d2f3adfd8318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Flow 'volume_create_manager' (1c626bfb-5987-41e9-add6-de8b50b2ea72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d50f748f-23db-4aa1-bcf1-fe2ed77ab760 tempest-VolumesNegativeTest-782085635 None] Created volume successfully.
Nov 05 04:24:45 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492
Nov 05 04:24:45 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:45 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492" returned: 0 in 0.762s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:24:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c960d5-b585-4637-886f-c08c44a91dc9]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:45 devstack sudo[98360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f
Nov 05 04:24:45 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:46 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" returned: 0 in 0.938s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:46 devstack sudo[98371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492
Nov 05 04:24:46 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:47 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492" returned: 0 in 0.576s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:47 devstack sudo[98377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492
Nov 05 04:24:47 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:47 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f.d6f054cf-74e8-4fb0-ba29-37ebfb66d492" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-d6f054cf-74e8-4fb0-ba29-37ebfb66d492" released by "_delete_snapshot" :: held 3.016s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" released by "delete_snapshot" :: held 3.086s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:48 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Created reservations ['93ea88f7-7ceb-4cfc-b063-afe3e9bb1fef', '767b14ae-0667-4349-8046-70c585bc6f5f', '31347492-909e-4772-8863-edc795533f58', 'eadac5a3-a9f2-4ec3-8090-dfa7de4f0ff8'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Delete snapshot completed successfully.
Nov 05 04:24:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-972231e9-4bf0-4f78-9f48-4ca09b50d5f7 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-d6f054cf-74e8-4fb0-ba29-37ebfb66d492-delete_snapshot" released by "delete_snapshot" :: held 3.532s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e47014-2fbc-4d0b-b68e-e86f523d532f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:49 devstack sudo[98385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f
Nov 05 04:24:49 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:50 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" returned: 0 in 0.678s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:50 devstack sudo[98401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f
Nov 05 04:24:50 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:50 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" returned: 0 in 0.436s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f" released by "delete_volume" :: held 1.271s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:50 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Created reservations ['a37e916d-eb7c-41f8-99b1-1d8267bd64c0', 'bc31eeed-05a3-4b0c-8248-1b885d4b51f7', 'fd7bd624-4e31-4d0f-9879-245c4adf36d3', 'd6d902a8-f356-4a35-90f7-8e7c721749d8'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:51 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:51 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:51 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.492s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Deleted volume successfully.
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4540cbfe-4410-4fd7-a9b7-66344337daa0 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-ccd3d7d1-d192-4d5d-ac8d-f57c5f0cfb7f-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-d3a38b40-a041-4b53-871c-22bb490666d5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-d3a38b40-a041-4b53-871c-22bb490666d5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "cinder-quobyte-d3a38b40-a041-4b53-871c-22bb490666d5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-d3a38b40-a041-4b53-871c-22bb490666d5" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c44dec-bb04-42cc-b8b3-170e670c3df3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:52 devstack sudo[98411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5
Nov 05 04:24:52 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:52 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5" returned: 0 in 0.650s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:52 devstack sudo[98416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5
Nov 05 04:24:52 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Flow 'volume_create_manager' (228879b1-5880-4149-90af-012e773e629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441531d1-3406-42a4-8614-b41ff3b981ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (441531d1-3406-42a4-8614-b41ff3b981ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1063315475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb8e1e8-1040-4596-a78d-8643b883a130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8825a5fe5a48559f9bf255534b01e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:53Z,use_quota=True,user_id='f8b6152de2664027ae256c5b69a6faee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b33e95-a71f-4384-bb0e-a02845dbc773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b33e95-a71f-4384-bb0e-a02845dbc773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2369ba8-a45f-4bc8-ba0e-bedd4f0cc85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2369ba8-a45f-4bc8-ba0e-bedd4f0cc85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb8e1e8-1040-4596-a78d-8643b883a130', 'volume_name': 'volume-4fb8e1e8-1040-4596-a78d-8643b883a130', 'volume_size': 2}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:53 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca6001-a249-4352-b4a8-c6eeac96711f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ca6001-a249-4352-b4a8-c6eeac96711f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027ab1c7-e7b0-47c9-b365-d881cb365fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Volume 4fb8e1e8-1040-4596-a78d-8643b883a130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb8e1e8-1040-4596-a78d-8643b883a130', 'volume_size': 2}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1063315475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fb8e1e8-1040-4596-a78d-8643b883a130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8825a5fe5a48559f9bf255534b01e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:24:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:24:53Z,use_quota=True,user_id='f8b6152de2664027ae256c5b69a6faee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Creating volume 4fb8e1e8-1040-4596-a78d-8643b883a130 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:24:53 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130 2147483648 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3a38b40-a041-4b53-871c-22bb490666d5" returned: 0 in 0.446s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:53 devstack sudo[98420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130 2147483648
Nov 05 04:24:53 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-quobyte-d3a38b40-a041-4b53-871c-22bb490666d5" released by "delete_volume" :: held 1.201s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Created reservations ['25baec79-9ec3-4e34-b0a6-aec2fe204062', '3576e149-0a40-4ff2-ba31-8781f5b5da1e', '37806142-1383-4457-8e4e-20ca12521e80', 'de5f0ffe-863a-4248-8c27-ecb82a717d6d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:53 devstack sudo[98422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:53 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:53 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Deleted volume successfully.
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2102a770-3ef1-4522-969b-d1e1016a4fe6 tempest-VolumesSnapshotTestJSON-943709473 None] Lock "cinder-d3a38b40-a041-4b53-871c-22bb490666d5-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:53 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130 2147483648" returned: 0 in 0.606s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:54 devstack sudo[98429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130
Nov 05 04:24:54 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:54 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130" returned: 0 in 0.584s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:24:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027ab1c7-e7b0-47c9-b365-d881cb365fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb8e1e8-1040-4596-a78d-8643b883a130', 'volume_size': 2}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170cabfc-d1da-4320-b62b-f985174b4dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:24:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Volume volume-4fb8e1e8-1040-4596-a78d-8643b883a130 (4fb8e1e8-1040-4596-a78d-8643b883a130): created successfully
Nov 05 04:24:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170cabfc-d1da-4320-b62b-f985174b4dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:24:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Flow 'volume_create_manager' (228879b1-5880-4149-90af-012e773e629a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:24:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4f16b5a1-8b7f-4fe8-a7ed-a54f4e64ac3c tempest-VolumesCloneNegativeTest-1753891870 None] Created volume successfully.
Nov 05 04:24:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Acquiring lock "cinder-4fb8e1e8-1040-4596-a78d-8643b883a130-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Lock "cinder-4fb8e1e8-1040-4596-a78d-8643b883a130-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Acquiring lock "cinder-quobyte-4fb8e1e8-1040-4596-a78d-8643b883a130" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:24:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Lock "cinder-quobyte-4fb8e1e8-1040-4596-a78d-8643b883a130" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:24:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36893f5-3f61-464e-bd3d-8b351c10e8b8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:24:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:56 devstack sudo[98498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130
Nov 05 04:24:56 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:57 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130" returned: 0 in 0.738s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:57 devstack sudo[98506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130
Nov 05 04:24:57 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:57 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4fb8e1e8-1040-4596-a78d-8643b883a130" returned: 0 in 0.382s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Lock "cinder-quobyte-4fb8e1e8-1040-4596-a78d-8643b883a130" released by "delete_volume" :: held 1.197s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Created reservations ['fc85b453-0c1c-4bf4-8902-8ae816514d56', '2943e024-1e4c-49ea-927f-43b14f46bfbd', '139bbf80-be1e-4e76-9771-7f0888dee228', '1abbd965-2ca2-48d9-abec-378236f3cfc6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:24:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:24:57 devstack sudo[98509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:24:57 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:24:58 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root
Nov 05 04:24:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:24:58 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:24:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Deleted volume successfully.
Nov 05 04:24:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-965811dc-49f7-46d1-a5c6-f2f3824eb2a7 tempest-VolumesCloneNegativeTest-1753891870 None] Lock "cinder-4fb8e1e8-1040-4596-a78d-8643b883a130-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=128,cinder:SELECT=97,cinder:DELETE=12,cinder:INSERT=28 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=103,cinder:INSERT=35,cinder:UPDATE=137,cinder:DELETE=10 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Flow 'volume_create_manager' (3bf6f446-599b-45a7-bd97-62ef412906c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf40f85-5e96-4e87-9121-8f09e6679c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf40f85-5e96-4e87-9121-8f09e6679c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-437549399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b9fadd-593c-48a1-8f3f-c359e529f76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d76f05569284059805a593da1568588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:05Z,use_quota=True,user_id='ebd2e478d6dd4c54bd2cd4c29c48ad26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd954662-0dfe-449a-b3ea-63d1bcfbe7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd954662-0dfe-449a-b3ea-63d1bcfbe7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b91dd9-4bdd-472d-9d3e-c02a0d33725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:04 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:25:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b91dd9-4bdd-472d-9d3e-c02a0d33725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b8b9fadd-593c-48a1-8f3f-c359e529f76e', 'volume_name': 'volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f26a9820>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de74c72-12ac-4286-81d4-43446f8808ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de74c72-12ac-4286-81d4-43446f8808ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565f6996-ac04-44d6-bb19-792f1c6951e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Volume b8b9fadd-593c-48a1-8f3f-c359e529f76e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f26a9820>}
Nov 05 04:25:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Trying to clone b8b9fadd-593c-48a1-8f3f-c359e529f76e from image 6ded3d1d-d482-4fc8-985e-41c27b256803 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:25:05 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:25:05 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 04:25:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a540cdbc-d5f0-42f0-9b6a-9f4b1e4c85e7]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:06 devstack sudo[98888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD
Nov 05 04:25:06 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:06 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:06 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 is fetched for user ebd2e478d6dd4c54bd2cd4c29c48ad26. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:25:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24017df-c771-4ae3-a319-c3e0bb0ab386]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:06 devstack sudo[98894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD
Nov 05 04:25:06 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:07 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-437549399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8b9fadd-593c-48a1-8f3f-c359e529f76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d76f05569284059805a593da1568588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:05Z,use_quota=True,user_id='ebd2e478d6dd4c54bd2cd4c29c48ad26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Creating volume b8b9fadd-593c-48a1-8f3f-c359e529f76e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:25:07 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:07 devstack sudo[98900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e 1073741824
Nov 05 04:25:07 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:07 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e 1073741824" returned: 0 in 0.633s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:07 devstack sudo[98906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e
Nov 05 04:25:07 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:08 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:25:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:08 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Attempting download of 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume b8b9fadd-593c-48a1-8f3f-c359e529f76e. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:25:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1637cade-fb3f-4e6a-8dd7-6be5bb2af59d]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_i_xzkj3q {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:08 devstack sudo[98909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_i_xzkj3q
Nov 05 04:25:08 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:08 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_i_xzkj3q" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_i_xzkj3q {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:08 devstack sudo[98913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_i_xzkj3q
Nov 05 04:25:08 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:09 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_i_xzkj3q" returned: 1 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_i_xzkj3q' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:25:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[624246a9-7622-471f-b212-544b342abcc4]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:09 devstack sudo[98917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD
Nov 05 04:25:09 devstack sudo[98917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:09 devstack sudo[98917]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:09 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] 6ded3d1d-d482-4fc8-985e-41c27b256803 was qcow2, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:25:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:09 devstack sudo[98924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e
Nov 05 04:25:09 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Acquiring lock "cinder-3ff49f22-3550-4580-a92e-e9c03300fc9d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Lock "cinder-3ff49f22-3550-4580-a92e-e9c03300fc9d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Acquiring lock "cinder-quobyte-3ff49f22-3550-4580-a92e-e9c03300fc9d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Lock "cinder-quobyte-3ff49f22-3550-4580-a92e-e9c03300fc9d" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf90a01a-7901-4346-852c-a3c61ad6b878]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:10 devstack sudo[98935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d
Nov 05 04:25:10 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:11 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:11 devstack sudo[98940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d
Nov 05 04:25:11 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:11 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Flow 'volume_create_manager' (541924dd-7735-4824-9661-8467064fb5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cb0ae7-7b22-41d3-9f12-d6664462139e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3ff49f22-3550-4580-a92e-e9c03300fc9d" returned: 0 in 0.431s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5cb0ae7-7b22-41d3-9f12-d6664462139e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1572251039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f78b17b-b7a6-4853-a63e-aed996473e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754658bcba164092b99a8c40e0767c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:12Z,use_quota=True,user_id='485b3dc51b1240f686b8c8e93e8b993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f4d9bb-94b2-4283-873f-4aa9dddf0040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f4d9bb-94b2-4283-873f-4aa9dddf0040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf87700-12b5-47df-b5b5-44934239540b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cf87700-12b5-47df-b5b5-44934239540b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f78b17b-b7a6-4853-a63e-aed996473e1a', 'volume_name': 'volume-2f78b17b-b7a6-4853-a63e-aed996473e1a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e450a1-89d7-45eb-85e4-a3cde7cca37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55e450a1-89d7-45eb-85e4-a3cde7cca37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf786b0-57c2-41bc-ba55-a76028348a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Volume 2f78b17b-b7a6-4853-a63e-aed996473e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f78b17b-b7a6-4853-a63e-aed996473e1a', 'volume_size': 1}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1572251039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f78b17b-b7a6-4853-a63e-aed996473e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='754658bcba164092b99a8c40e0767c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:12Z,use_quota=True,user_id='485b3dc51b1240f686b8c8e93e8b993e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Creating volume 2f78b17b-b7a6-4853-a63e-aed996473e1a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:25:11 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Lock "cinder-quobyte-3ff49f22-3550-4580-a92e-e9c03300fc9d" released by "delete_volume" :: held 1.083s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:11 devstack sudo[98944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a 1073741824
Nov 05 04:25:11 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Created reservations ['6cfe72dc-dcfa-40aa-887f-47bdd76eb347', 'c6897a49-44a8-4357-9738-727892943bc2', '622f7ea4-d9b2-4ba7-8efd-f225b05aeb6e', '0c09961f-dbec-4684-9fdb-e3fd45417697'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:11 devstack sudo[98946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:11 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:12 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e" returned: 0 in 2.573s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_g8wb8qwhdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:25:12 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Converted 112.00 MB image at 43.50 MB/s
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:12 devstack sudo[98952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e 1G
Nov 05 04:25:12 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:12 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.302s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Deleted volume successfully.
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-84f935e8-40f8-42fb-947e-8c79b54a0813 tempest-VolumesNegativeTest-782085635 None] Lock "cinder-3ff49f22-3550-4580-a92e-e9c03300fc9d-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:12 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a 1073741824" returned: 0 in 0.633s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:12 devstack sudo[98955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a
Nov 05 04:25:12 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:12 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e 1G" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Downloaded image 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume b8b9fadd-593c-48a1-8f3f-c359e529f76e successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 for user ebd2e478d6dd4c54bd2cd4c29c48ad26 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Marking volume b8b9fadd-593c-48a1-8f3f-c359e529f76e as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Copying metadata from image 6ded3d1d-d482-4fc8-985e-41c27b256803 to b8b9fadd-593c-48a1-8f3f-c359e529f76e. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Creating volume glance metadata for volume b8b9fadd-593c-48a1-8f3f-c359e529f76e backed by image 6ded3d1d-d482-4fc8-985e-41c27b256803 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:25:12 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a" returned: 0 in 0.271s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565f6996-ac04-44d6-bb19-792f1c6951e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f26a9820>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cf0f5c-f02f-48db-8bbf-0b5597f02b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf786b0-57c2-41bc-ba55-a76028348a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f78b17b-b7a6-4853-a63e-aed996473e1a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dcafec-d619-4393-bf05-d8428645ac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Volume volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e (b8b9fadd-593c-48a1-8f3f-c359e529f76e): created successfully
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95cf0f5c-f02f-48db-8bbf-0b5597f02b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Flow 'volume_create_manager' (3bf6f446-599b-45a7-bd97-62ef412906c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Volume volume-2f78b17b-b7a6-4853-a63e-aed996473e1a (2f78b17b-b7a6-4853-a63e-aed996473e1a): created successfully
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00dcafec-d619-4393-bf05-d8428645ac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Flow 'volume_create_manager' (541924dd-7735-4824-9661-8467064fb5ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-66caf76f-27ec-4a30-8c39-95f987e1417a tempest-VolumesExtendTest-2000550823 None] Created volume successfully.
Nov 05 04:25:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5150fc0c-d520-4cdf-961d-45382648116b tempest-AttachVolumeNegativeTest-1975972844 None] Created volume successfully.
Nov 05 04:25:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5101a9f0-1c34-4dfe-8696-cf8ccf04bc85 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5101a9f0-1c34-4dfe-8696-cf8ccf04bc85 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cfd502-6857-48e3-8b81-912588e05ab9]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5101a9f0-1c34-4dfe-8696-cf8ccf04bc85 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:13 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e
Nov 05 04:25:13 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:14 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5101a9f0-1c34-4dfe-8696-cf8ccf04bc85 tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e" returned: 0 in 0.594s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5101a9f0-1c34-4dfe-8696-cf8ccf04bc85 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e 2G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5101a9f0-1c34-4dfe-8696-cf8ccf04bc85 tempest-VolumesExtendTest-2000550823 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e 2G" returned: 0 in 0.165s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5101a9f0-1c34-4dfe-8696-cf8ccf04bc85 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.804s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5101a9f0-1c34-4dfe-8696-cf8ccf04bc85 tempest-VolumesExtendTest-2000550823 None] Extend volume completed successfully.
Nov 05 04:25:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ed2e259d-e63f-4649-8076-72e5cdb8d6ce req-9f80e326-a353-4bd4-9133-95fb5e146e80 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ed2e259d-e63f-4649-8076-72e5cdb8d6ce req-9f80e326-a353-4bd4-9133-95fb5e146e80 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-ed2e259d-e63f-4649-8076-72e5cdb8d6ce req-9f80e326-a353-4bd4-9133-95fb5e146e80 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-ed2e259d-e63f-4649-8076-72e5cdb8d6ce req-9f80e326-a353-4bd4-9133-95fb5e146e80 tempest-AttachVolumeNegativeTest-1975972844 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-2f78b17b-b7a6-4853-a63e-aed996473e1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2842798d-b598-466f-832c-72c8e1bca627', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:25:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-ed2e259d-e63f-4649-8076-72e5cdb8d6ce req-9f80e326-a353-4bd4-9133-95fb5e146e80 tempest-AttachVolumeNegativeTest-1975972844 None] attachment_update completed successfully.
Nov 05 04:25:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "cinder-b8b9fadd-593c-48a1-8f3f-c359e529f76e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-b8b9fadd-593c-48a1-8f3f-c359e529f76e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "cinder-quobyte-b8b9fadd-593c-48a1-8f3f-c359e529f76e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-quobyte-b8b9fadd-593c-48a1-8f3f-c359e529f76e" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaa24fc-7579-46c6-8c22-924d2915551e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:15 devstack sudo[99485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e
Nov 05 04:25:15 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:16 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e" returned: 0 in 0.552s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:16 devstack sudo[99491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e
Nov 05 04:25:16 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:16 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b8b9fadd-593c-48a1-8f3f-c359e529f76e" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-quobyte-b8b9fadd-593c-48a1-8f3f-c359e529f76e" released by "delete_volume" :: held 0.938s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Created reservations ['9352410e-7b46-446e-b424-dfa6de826e5c', 'aefef175-f256-4ce5-9d51-b1dc1476838b', 'ed683927-4746-4f11-9f91-2cac5b910290', 'dd6c6585-5dbd-44bd-ad35-3ba2908c504c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:16 devstack sudo[99494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:16 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:17 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Deleted volume successfully.
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1e7acf50-563f-47e4-8537-ca1609bf6772 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-b8b9fadd-593c-48a1-8f3f-c359e529f76e-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Flow 'volume_create_manager' (fbe6faf4-0334-4bdc-9cb8-7526318127c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ba66dd-4b59-4e3d-a7b1-6ff6646e1412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ba66dd-4b59-4e3d-a7b1-6ff6646e1412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-277272049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf059496-fdc5-4c02-8b21-a8f87498a3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d76f05569284059805a593da1568588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:18Z,use_quota=True,user_id='ebd2e478d6dd4c54bd2cd4c29c48ad26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c498af8d-1849-430e-91d8-39428c66c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c498af8d-1849-430e-91d8-39428c66c08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6126b7-abb6-4849-8f0e-e891911da50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6126b7-abb6-4849-8f0e-e891911da50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf059496-fdc5-4c02-8b21-a8f87498a3d2', 'volume_name': 'volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22180b7f-e4c0-4bce-90ce-de616c25b20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22180b7f-e4c0-4bce-90ce-de616c25b20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ba089e-ac74-4fea-8a4a-70b6cf9c5354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Volume cf059496-fdc5-4c02-8b21-a8f87498a3d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2', 'volume_size': 1}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-277272049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf059496-fdc5-4c02-8b21-a8f87498a3d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d76f05569284059805a593da1568588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:18Z,use_quota=True,user_id='ebd2e478d6dd4c54bd2cd4c29c48ad26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Creating volume cf059496-fdc5-4c02-8b21-a8f87498a3d2 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:25:17 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:25:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:17 devstack sudo[99503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 1073741824
Nov 05 04:25:17 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-2429fae3-9b3d-4718-9946-2fd1c207d854 req-dc556525-2b72-4a79-8704-31b832c28ef6 tempest-AttachVolumeNegativeTest-1975972844 None] Terminate volume connection completed successfully.
Nov 05 04:25:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-2429fae3-9b3d-4718-9946-2fd1c207d854 req-dc556525-2b72-4a79-8704-31b832c28ef6 tempest-AttachVolumeNegativeTest-1975972844 None] Deleting attachment 2842798d-b598-466f-832c-72c8e1bca627. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:25:18 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 1073741824" returned: 0 in 0.779s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:18 devstack sudo[99535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2
Nov 05 04:25:18 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:19 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:25:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.361s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19ba089e-ac74-4fea-8a4a-70b6cf9c5354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe93608c-73e7-4954-8b9c-d0b54460610b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Volume volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 (cf059496-fdc5-4c02-8b21-a8f87498a3d2): created successfully
Nov 05 04:25:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe93608c-73e7-4954-8b9c-d0b54460610b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Flow 'volume_create_manager' (fbe6faf4-0334-4bdc-9cb8-7526318127c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-95136f93-5b87-4ea5-ac72-27a01c1993a9 tempest-VolumesExtendTest-2000550823 None] Created volume successfully.
Nov 05 04:25:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Creating offline snapshot 33cf1087-433a-4b6c-a340-beaafb8961e6 of volume cf059496-fdc5-4c02-8b21-a8f87498a3d2 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:25:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5a70bd-ed7a-4946-a94a-e3f2b447b574]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:20 devstack sudo[99560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2
Nov 05 04:25:20 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:20 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2" returned: 0 in 0.506s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:20 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 1G
Nov 05 04:25:20 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:21 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 1G" returned: 0 in 0.555s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:21 devstack sudo[99572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6
Nov 05 04:25:21 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:21 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:21 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 is being set with open permissions: ugo+rw
Nov 05 04:25:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:21 devstack sudo[99579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6
Nov 05 04:25:21 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:21 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6" returned: 0 in 0.328s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:21 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.info
Nov 05 04:25:21 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:22 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.info" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:22 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.info is being set with open permissions: ugo+rw
Nov 05 04:25:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:22 devstack sudo[99586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.info
Nov 05 04:25:22 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:22 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.info" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.497s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ca8924fa-49da-499b-a374-e865743355a4 tempest-VolumesExtendTest-2000550823 None] Create snapshot completed successfully
Nov 05 04:25:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c3255c1-77a3-4e4f-85ec-03876fcb3728 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c3255c1-77a3-4e4f-85ec-03876fcb3728 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f2558b-0404-40de-8c75-9f2f35e3539d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c3255c1-77a3-4e4f-85ec-03876fcb3728 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:23 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2
Nov 05 04:25:23 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:23 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c3255c1-77a3-4e4f-85ec-03876fcb3728 tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2" returned: 0 in 0.467s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c3255c1-77a3-4e4f-85ec-03876fcb3728 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 2G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1c3255c1-77a3-4e4f-85ec-03876fcb3728 tempest-VolumesExtendTest-2000550823 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 2G" returned: 0 in 0.180s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1c3255c1-77a3-4e4f-85ec-03876fcb3728 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.710s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1c3255c1-77a3-4e4f-85ec-03876fcb3728 tempest-VolumesExtendTest-2000550823 None] Extend volume completed successfully.
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "cinder-33cf1087-433a-4b6c-a340-beaafb8961e6-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-33cf1087-433a-4b6c-a340-beaafb8961e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "cinder-quobyte-cf059496-fdc5-4c02-8b21-a8f87498a3d2" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-quobyte-cf059496-fdc5-4c02-8b21-a8f87498a3d2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "cinder-quobyte-33cf1087-433a-4b6c-a340-beaafb8961e6" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-quobyte-33cf1087-433a-4b6c-a340-beaafb8961e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Deleting offline snapshot 33cf1087-433a-4b6c-a340-beaafb8961e6 of volume cf059496-fdc5-4c02-8b21-a8f87498a3d2 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] snapshot_file for this snap is: volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a08c42-2c88-443f-a631-7ead234d8278]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:24 devstack sudo[99598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6
Nov 05 04:25:24 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:25 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6" returned: 0 in 0.476s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:25:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cff3b6-c5e9-4644-ad71-0ba36a5986b0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:25 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2
Nov 05 04:25:25 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:25 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2" returned: 0 in 0.413s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:25 devstack sudo[99609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6
Nov 05 04:25:25 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:26 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6" returned: 0 in 0.400s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:26 devstack sudo[99614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6
Nov 05 04:25:26 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:26 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2.33cf1087-433a-4b6c-a340-beaafb8961e6" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-quobyte-33cf1087-433a-4b6c-a340-beaafb8961e6" released by "_delete_snapshot" :: held 1.735s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-quobyte-cf059496-fdc5-4c02-8b21-a8f87498a3d2" released by "delete_snapshot" :: held 1.764s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Created reservations ['ea462c2d-5cf8-4aae-a161-b73d01d28eb8', '8d3c9f70-7e3f-4d4f-b239-254b29b3c676', 'f3c3d763-ec43-46bd-ab8c-fd8c74226d9c', '4fb63054-6e2d-4176-8a2c-82e61554ce29'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Delete snapshot completed successfully.
Nov 05 04:25:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a228a61a-85e5-4bac-bbff-7da96a3ff6b5 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-33cf1087-433a-4b6c-a340-beaafb8961e6-delete_snapshot" released by "delete_snapshot" :: held 1.975s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "cinder-cf059496-fdc5-4c02-8b21-a8f87498a3d2-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-cf059496-fdc5-4c02-8b21-a8f87498a3d2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "cinder-quobyte-cf059496-fdc5-4c02-8b21-a8f87498a3d2" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-quobyte-cf059496-fdc5-4c02-8b21-a8f87498a3d2" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e29935-efdb-4433-9beb-673c709120e7]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:27 devstack sudo[99617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2
Nov 05 04:25:27 devstack sudo[99617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:27 devstack sudo[99617]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2" returned: 0 in 0.558s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:27 devstack sudo[99623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2
Nov 05 04:25:27 devstack sudo[99623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:28 devstack sudo[99623]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf059496-fdc5-4c02-8b21-a8f87498a3d2" returned: 0 in 0.634s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-quobyte-cf059496-fdc5-4c02-8b21-a8f87498a3d2" released by "delete_volume" :: held 1.304s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "cinder-2f78b17b-b7a6-4853-a63e-aed996473e1a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-2f78b17b-b7a6-4853-a63e-aed996473e1a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "cinder-quobyte-2f78b17b-b7a6-4853-a63e-aed996473e1a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-quobyte-2f78b17b-b7a6-4853-a63e-aed996473e1a" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Created reservations ['ab14096f-8690-4305-aa69-2f399d6c7784', '08157650-a4ff-4920-b42b-80637eb981c5', 'dd0c6fe9-7eb2-4f24-9390-b00912629e25', 'd5a54862-9e60-47f7-ab15-201d195aac0c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f5cd53-79a7-476b-899e-4d04eeed34a1]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:28 devstack sudo[99663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:28 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:28 devstack sudo[99662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a
Nov 05 04:25:28 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:29 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Deleted volume successfully.
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76625fa5-dc6a-4a93-b464-63f56b5678e4 tempest-VolumesExtendTest-2000550823 None] Lock "cinder-cf059496-fdc5-4c02-8b21-a8f87498a3d2-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:29 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a" returned: 0 in 0.504s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:29 devstack sudo[99672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a
Nov 05 04:25:29 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:29 devstack sudo[99674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:29 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:29 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2f78b17b-b7a6-4853-a63e-aed996473e1a" returned: 0 in 0.473s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:29 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.460s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-quobyte-2f78b17b-b7a6-4853-a63e-aed996473e1a" released by "delete_volume" :: held 1.053s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Created reservations ['a46ba2d0-1f29-4429-a95c-c9f5031049eb', '9b27ccb8-5ebf-434a-9937-50f9575d53b2', '60460618-b040-4825-8977-1b293cbb4eb7', '8fcfa8ef-1ff5-4dc2-8632-fd39371d44bd'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:29 devstack sudo[99679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:29 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:30 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.321s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:30 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Deleted volume successfully.
Nov 05 04:25:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8e50da47-08fc-4eab-8257-91f60769ee19 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-2f78b17b-b7a6-4853-a63e-aed996473e1a-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "cinder-7174931c-7826-456a-9d94-0a6edb28865a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-7174931c-7826-456a-9d94-0a6edb28865a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "cinder-quobyte-7174931c-7826-456a-9d94-0a6edb28865a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-quobyte-7174931c-7826-456a-9d94-0a6edb28865a" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[090f0eb9-529d-4097-8850-922e56cb338c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:31 devstack sudo[99682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a
Nov 05 04:25:31 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:31 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a" returned: 0 in 0.459s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:31 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a
Nov 05 04:25:31 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:31 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7174931c-7826-456a-9d94-0a6edb28865a" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-quobyte-7174931c-7826-456a-9d94-0a6edb28865a" released by "delete_volume" :: held 0.772s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Created reservations ['10e123b9-ead8-4528-ac06-fb244d2f5c2b', '643c1519-796c-4085-9af6-06863a9fdd6d', '70de9025-38cb-4683-90df-09a0249b7de3', 'c049a333-0b50-4723-93c9-02a4fb678b77'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:31 devstack sudo[99690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:31 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:32 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Deleted volume successfully.
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-60cfb70c-7933-4fb0-8a92-137829fe6c52 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-7174931c-7826-456a-9d94-0a6edb28865a-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "cinder-9f944edf-7aee-4efa-8753-1cc29bb0349a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-9f944edf-7aee-4efa-8753-1cc29bb0349a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "cinder-quobyte-9f944edf-7aee-4efa-8753-1cc29bb0349a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-quobyte-9f944edf-7aee-4efa-8753-1cc29bb0349a" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[27452960-0369-407d-ac97-48d47d45ca71]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:32 devstack sudo[99693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a
Nov 05 04:25:32 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:32 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:32 devstack sudo[99698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a
Nov 05 04:25:32 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:33 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9f944edf-7aee-4efa-8753-1cc29bb0349a" returned: 0 in 0.377s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-quobyte-9f944edf-7aee-4efa-8753-1cc29bb0349a" released by "delete_volume" :: held 0.850s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Created reservations ['e5a07647-1e19-4cb0-bf6f-46596e9d082d', 'be59f419-f3b3-420a-83c4-e2b56f1c2926', '3fc407da-e885-45da-b2bf-44a68972bc83', '9aab9fc3-43e0-4f85-bb7b-ea68354f1128'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:33 devstack sudo[99701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:33 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:33 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Deleted volume successfully.
Nov 05 04:25:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8bc5ef5-e066-412d-8598-1f74f73329d7 tempest-AttachVolumeNegativeTest-1975972844 None] Lock "cinder-9f944edf-7aee-4efa-8753-1cc29bb0349a-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (d5bd8ddd-bed3-45fa-94b1-2b58ed16fe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55249b6-4f38-464e-b029-ab6e152b9357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55249b6-4f38-464e-b029-ab6e152b9357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-121129368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86163ea4-05bb-43c1-a6a6-35653e3d7c3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:37Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bb0d87-8188-4178-9a03-8cbcd86541b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61bb0d87-8188-4178-9a03-8cbcd86541b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2cb1978-b839-45dc-a70f-ebef9cfb26a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2cb1978-b839-45dc-a70f-ebef9cfb26a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86163ea4-05bb-43c1-a6a6-35653e3d7c3f', 'volume_name': 'volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e128944-9b4c-4d22-ae32-69a731f3dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e128944-9b4c-4d22-ae32-69a731f3dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23591916-8bbb-4a94-b085-003827a71cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Volume 86163ea4-05bb-43c1-a6a6-35653e3d7c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f', 'volume_size': 1}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-121129368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86163ea4-05bb-43c1-a6a6-35653e3d7c3f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:37Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Creating volume 86163ea4-05bb-43c1-a6a6-35653e3d7c3f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:25:37 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:25:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:37 devstack sudo[99705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f 1073741824
Nov 05 04:25:37 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:38 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f 1073741824" returned: 0 in 0.570s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:38 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f
Nov 05 04:25:38 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:38 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:25:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23591916-8bbb-4a94-b085-003827a71cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49b2bfb-e3ea-46e6-894d-a1667c7068a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Volume volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f (86163ea4-05bb-43c1-a6a6-35653e3d7c3f): created successfully
Nov 05 04:25:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f49b2bfb-e3ea-46e6-894d-a1667c7068a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (d5bd8ddd-bed3-45fa-94b1-2b58ed16fe28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a83477c4-ed71-40b7-87bf-c953c9152195 tempest-VolumesGetTest-612649850 None] Created volume successfully.
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (9a73f924-4fb1-482f-ac02-08cd0ff3c3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd61677c-e5a6-4309-a2d6-21dd966b1b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd61677c-e5a6-4309-a2d6-21dd966b1b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-623021823',display_name='tempest-VolumesGetTest-Volume-1067762080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792b7385-a670-4725-84a7-4607667e3721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:40Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764f4f0f-a458-4269-8f64-5e93dcc37d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764f4f0f-a458-4269-8f64-5e93dcc37d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d65534-0ebc-4582-889f-37b11d3b57a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d65534-0ebc-4582-889f-37b11d3b57a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792b7385-a670-4725-84a7-4607667e3721', 'volume_name': 'volume-792b7385-a670-4725-84a7-4607667e3721', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fc226e-97b8-4143-8dd1-40c9fe718c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fc226e-97b8-4143-8dd1-40c9fe718c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21664f7-d9a6-4305-8c62-958feb1c0460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:40 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Volume 792b7385-a670-4725-84a7-4607667e3721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792b7385-a670-4725-84a7-4607667e3721', 'volume_size': 1}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-623021823',display_name='tempest-VolumesGetTest-Volume-1067762080',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792b7385-a670-4725-84a7-4607667e3721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:40Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Creating volume 792b7385-a670-4725-84a7-4607667e3721 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:25:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:25:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:40 devstack sudo[99716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721 1073741824
Nov 05 04:25:40 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:41 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721 1073741824" returned: 0 in 0.554s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:41 devstack sudo[99722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721
Nov 05 04:25:41 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:41 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:25:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a21664f7-d9a6-4305-8c62-958feb1c0460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792b7385-a670-4725-84a7-4607667e3721', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b665c0-007b-4ed5-bdca-eafaa097156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Volume volume-792b7385-a670-4725-84a7-4607667e3721 (792b7385-a670-4725-84a7-4607667e3721): created successfully
Nov 05 04:25:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b665c0-007b-4ed5-bdca-eafaa097156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (9a73f924-4fb1-482f-ac02-08cd0ff3c3de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a3376938-bdb0-4934-b1f3-0a4f4b4bf36e tempest-VolumesGetTest-612649850 None] Created volume successfully.
Nov 05 04:25:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-792b7385-a670-4725-84a7-4607667e3721-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Lock "cinder-792b7385-a670-4725-84a7-4607667e3721-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-quobyte-792b7385-a670-4725-84a7-4607667e3721" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-792b7385-a670-4725-84a7-4607667e3721" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd625b61-be2f-405d-98eb-c51c5ec912ec]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:43 devstack sudo[99725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721
Nov 05 04:25:43 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:43 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721" returned: 0 in 0.480s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:43 devstack sudo[99730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721
Nov 05 04:25:43 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:43 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-792b7385-a670-4725-84a7-4607667e3721" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-792b7385-a670-4725-84a7-4607667e3721" released by "delete_volume" :: held 0.910s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Created reservations ['6705c58e-38ed-45b4-9e33-abb14ffac2e3', '89eb0db7-5fdd-4edd-9126-2f9d72835e64', 'c2c6a0a0-2464-4876-b05d-70d7dd9ffe5f', 'ae5fc104-9314-42b8-ae33-a0b4d6b62212'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:44 devstack sudo[99733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:44 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:44 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:44 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Deleted volume successfully.
Nov 05 04:25:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f27a64b2-7177-47ec-8355-68b42a36a253 tempest-VolumesGetTest-612649850 None] Lock "cinder-792b7385-a670-4725-84a7-4607667e3721-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-86163ea4-05bb-43c1-a6a6-35653e3d7c3f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Lock "cinder-86163ea4-05bb-43c1-a6a6-35653e3d7c3f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-quobyte-86163ea4-05bb-43c1-a6a6-35653e3d7c3f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-86163ea4-05bb-43c1-a6a6-35653e3d7c3f" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc7aebd-c275-4bdd-97a3-5841df9374a1]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:45 devstack sudo[99736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f
Nov 05 04:25:45 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:45 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f" returned: 0 in 0.460s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:45 devstack sudo[99741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f
Nov 05 04:25:45 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:46 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-86163ea4-05bb-43c1-a6a6-35653e3d7c3f" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-86163ea4-05bb-43c1-a6a6-35653e3d7c3f" released by "delete_volume" :: held 0.888s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Created reservations ['1a2930b1-8ed8-45e5-a929-2fd0667fa8ea', 'a63e7ba9-3d6a-4fef-a1fd-adf72ef9239c', '0c7589d4-c51d-4a35-a163-f14cc4828a6a', 'e08f8586-cc92-414f-a606-2ca0778b10f0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:46 devstack sudo[99745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:46 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:46 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Deleted volume successfully.
Nov 05 04:25:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8a0ba938-69f6-4044-802e-0edd489e9e36 tempest-VolumesGetTest-612649850 None] Lock "cinder-86163ea4-05bb-43c1-a6a6-35653e3d7c3f-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (827977b3-27bd-41e3-9e9a-7d4088244c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee4aa8-4226-4a32-b8a8-3751e2d86740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83ee4aa8-4226-4a32-b8a8-3751e2d86740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1371366618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dc24af-62ad-46c3-8edb-98e337e2748c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:47Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55599656-583b-476b-8207-5a9cd8895135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55599656-583b-476b-8207-5a9cd8895135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfc4911-5fbf-44ce-9887-76b9a3c2e63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfc4911-5fbf-44ce-9887-76b9a3c2e63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2dc24af-62ad-46c3-8edb-98e337e2748c', 'volume_name': 'volume-a2dc24af-62ad-46c3-8edb-98e337e2748c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dabcfc-ad86-49cd-aa2e-b7455a34536d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01dabcfc-ad86-49cd-aa2e-b7455a34536d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf9eda4-b878-49aa-920e-fc32e931c0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:47 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Volume a2dc24af-62ad-46c3-8edb-98e337e2748c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2dc24af-62ad-46c3-8edb-98e337e2748c', 'volume_size': 1}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1371366618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2dc24af-62ad-46c3-8edb-98e337e2748c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:47Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Creating volume a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:25:47 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:47 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c 1073741824
Nov 05 04:25:47 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:47 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c 1073741824" returned: 0 in 0.584s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:47 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c
Nov 05 04:25:47 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Flow 'volume_create_manager' (b1c7603e-746d-4ba5-bb77-f92e357e50bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b30b3a-594d-40d6-9b52-972f0f4a3874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b30b3a-594d-40d6-9b52-972f0f4a3874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1424278273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a9b47d-e2e7-4a56-bbe5-38897f827509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3654216d42f24761b0936c6a3a3890ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:48Z,use_quota=True,user_id='94f572d7b65145bca2e707d92f064077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17384d4c-0a15-46a2-bf8d-abc91ddb5aca),volume_type_id=17384d4c-0a15-46a2-bf8d-abc91ddb5aca)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76be65cd-e3c3-4dd5-9283-1e41bed7834b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76be65cd-e3c3-4dd5-9283-1e41bed7834b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7f5b40-6aae-4161-8665-4c2bec23e5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7f5b40-6aae-4161-8665-4c2bec23e5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a9b47d-e2e7-4a56-bbe5-38897f827509', 'volume_name': 'volume-58a9b47d-e2e7-4a56-bbe5-38897f827509', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a332e076-81fe-4a79-82a4-f13f94e8c142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a332e076-81fe-4a79-82a4-f13f94e8c142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ac10ee-02b4-453b-9604-4daa438248ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Volume 58a9b47d-e2e7-4a56-bbe5-38897f827509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a9b47d-e2e7-4a56-bbe5-38897f827509', 'volume_size': 1}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:48 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c" returned: 0 in 0.612s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1424278273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a9b47d-e2e7-4a56-bbe5-38897f827509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3654216d42f24761b0936c6a3a3890ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:48Z,use_quota=True,user_id='94f572d7b65145bca2e707d92f064077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(17384d4c-0a15-46a2-bf8d-abc91ddb5aca),volume_type_id=17384d4c-0a15-46a2-bf8d-abc91ddb5aca)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Creating volume 58a9b47d-e2e7-4a56-bbe5-38897f827509 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:25:48 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf9eda4-b878-49aa-920e-fc32e931c0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2dc24af-62ad-46c3-8edb-98e337e2748c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack sudo[99760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509 1073741824
Nov 05 04:25:48 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c017536d-b671-417f-9f1e-eb14007af15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Volume volume-a2dc24af-62ad-46c3-8edb-98e337e2748c (a2dc24af-62ad-46c3-8edb-98e337e2748c): created successfully
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c017536d-b671-417f-9f1e-eb14007af15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (827977b3-27bd-41e3-9e9a-7d4088244c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5c71edd0-d4d4-48d0-95d3-74843ca0b097 tempest-VolumesGetTest-612649850 None] Created volume successfully.
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Flow 'volume_create_manager' (ddc91a32-56c5-4a1b-ada2-08fc617ff2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbacf4b2-f827-4652-b938-8bb22352a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbacf4b2-f827-4652-b938-8bb22352a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1741315936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a3494c-40be-4506-b174-b8d1fefdce48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3654216d42f24761b0936c6a3a3890ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:49Z,use_quota=True,user_id='94f572d7b65145bca2e707d92f064077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99cec137-4483-4eed-a7ae-5c1c957a6fad),volume_type_id=99cec137-4483-4eed-a7ae-5c1c957a6fad)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cce5cd-a5c3-42af-a5ab-c77b4a99126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cce5cd-a5c3-42af-a5ab-c77b4a99126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e53ce4-c970-4dbe-860d-6d397d2d0e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e53ce4-c970-4dbe-860d-6d397d2d0e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a3494c-40be-4506-b174-b8d1fefdce48', 'volume_name': 'volume-72a3494c-40be-4506-b174-b8d1fefdce48', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caacd9af-29e8-4a66-aef4-faa648e7a518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caacd9af-29e8-4a66-aef4-faa648e7a518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad852d8-c7a8-4cbc-aea5-55a97d84929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Volume 72a3494c-40be-4506-b174-b8d1fefdce48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a3494c-40be-4506-b174-b8d1fefdce48', 'volume_size': 1}
Nov 05 04:25:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:49 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509 1073741824" returned: 0 in 0.679s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:49 devstack sudo[99766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509
Nov 05 04:25:49 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:49 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Flow 'volume_create_manager' (22cb1391-2117-48c0-8b57-b50d6c6d1185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5718ab40-832d-4d5f-95e9-68f8f924cfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509" returned: 0 in 0.516s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1741315936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a3494c-40be-4506-b174-b8d1fefdce48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3654216d42f24761b0936c6a3a3890ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:49Z,use_quota=True,user_id='94f572d7b65145bca2e707d92f064077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99cec137-4483-4eed-a7ae-5c1c957a6fad),volume_type_id=99cec137-4483-4eed-a7ae-5c1c957a6fad)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Creating volume 72a3494c-40be-4506-b174-b8d1fefdce48 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:25:49 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95ac10ee-02b4-453b-9604-4daa438248ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a9b47d-e2e7-4a56-bbe5-38897f827509', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af6fc91-c26b-4e74-af48-dda133d4ebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5718ab40-832d-4d5f-95e9-68f8f924cfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1475120746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d93493-9ddf-45a9-839b-7bb0b768430e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3654216d42f24761b0936c6a3a3890ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:50Z,use_quota=True,user_id='94f572d7b65145bca2e707d92f064077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(365efae6-c480-4318-9679-a20e471fb283),volume_type_id=365efae6-c480-4318-9679-a20e471fb283)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b5eac9-e356-4ddf-95dd-9902e1c831df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:49 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48 1073741824
Nov 05 04:25:49 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b5eac9-e356-4ddf-95dd-9902e1c831df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc79bed3-f391-4dc8-9f90-dd76146475d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:25:49 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Volume volume-58a9b47d-e2e7-4a56-bbe5-38897f827509 (58a9b47d-e2e7-4a56-bbe5-38897f827509): created successfully
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af6fc91-c26b-4e74-af48-dda133d4ebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:49 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Flow 'volume_create_manager' (b1c7603e-746d-4ba5-bb77-f92e357e50bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-392717f7-9d6c-4e7f-a52e-30b9b9cd9794 tempest-TestInstancesWithCinderVolumes-966562766 None] Created volume successfully.
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (8450c9d4-9233-4c6c-85d8-636ee348ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a078fec0-01fe-4438-bd6b-a5996d245f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:50 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48 1073741824" returned: 0 in 0.829s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a078fec0-01fe-4438-bd6b-a5996d245f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-137919010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abba8a6b-0ea0-4e5d-8af4-9b0b47994d21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a2dc24af-62ad-46c3-8edb-98e337e2748c,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:50Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9404d42c-a400-4bf4-9869-d18581a474a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9404d42c-a400-4bf4-9869-d18581a474a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e5473f-63b4-4f8b-9228-2aeacb8bdca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e5473f-63b4-4f8b-9228-2aeacb8bdca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'abba8a6b-0ea0-4e5d-8af4-9b0b47994d21', 'volume_name': 'volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21', 'volume_size': 1, 'source_volid': 'a2dc24af-62ad-46c3-8edb-98e337e2748c', 'source_volstatus': 'available'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d4477e-2750-4c10-a326-df398b8de516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d4477e-2750-4c10-a326-df398b8de516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb93bd2b-6b17-4b42-ad5e-464ad6294501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:50 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Volume abba8a6b-0ea0-4e5d-8af4-9b0b47994d21: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21', 'volume_size': 1, 'source_volid': 'a2dc24af-62ad-46c3-8edb-98e337e2748c', 'source_volstatus': 'available'}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc79bed3-f391-4dc8-9f90-dd76146475d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49d93493-9ddf-45a9-839b-7bb0b768430e', 'volume_name': 'volume-49d93493-9ddf-45a9-839b-7bb0b768430e', 'volume_size': 1, 'image_id': '538978c9-4594-46be-b3bf-0cfa4f2202af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/538978c9-4594-46be-b3bf-0cfa4f2202af', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1842391720', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3654216d42f24761b0936c6a3a3890ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '538978c9-4594-46be-b3bf-0cfa4f2202af', 'created_at': datetime.datetime(2026, 11, 5, 3, 25, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 25, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/538978c9-4594-46be-b3bf-0cfa4f2202af/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7ed1e80>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:50 devstack sudo[99793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48
Nov 05 04:25:50 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bc0bb8-09d8-4e85-af13-f33564910207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00bc0bb8-09d8-4e85-af13-f33564910207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56f3b96-309d-4428-9414-f019b2bb25b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:50 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Volume 49d93493-9ddf-45a9-839b-7bb0b768430e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49d93493-9ddf-45a9-839b-7bb0b768430e', 'volume_size': 1, 'image_id': '538978c9-4594-46be-b3bf-0cfa4f2202af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/538978c9-4594-46be-b3bf-0cfa4f2202af', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1842391720', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3654216d42f24761b0936c6a3a3890ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '538978c9-4594-46be-b3bf-0cfa4f2202af', 'created_at': datetime.datetime(2026, 11, 5, 3, 25, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 25, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/538978c9-4594-46be-b3bf-0cfa4f2202af/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7ed1e80>}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Trying to clone 49d93493-9ddf-45a9-839b-7bb0b768430e from image 538978c9-4594-46be-b3bf-0cfa4f2202af at location (None, [{'url': 'file:///opt/stack/data/glance/images/538978c9-4594-46be-b3bf-0cfa4f2202af', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:25:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:51 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48" returned: 0 in 0.360s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.279s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:51 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Cloning volume a2dc24af-62ad-46c3-8edb-98e337e2748c to volume abba8a6b-0ea0-4e5d-8af4-9b0b47994d21
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ad852d8-c7a8-4cbc-aea5-55a97d84929e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a3494c-40be-4506-b174-b8d1fefdce48', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a39235d-6fe5-4bca-bb11-7a02810afdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Creating offline snapshot 12fbe005-8301-42e0-885e-71929010dffb of volume a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:25:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Volume volume-72a3494c-40be-4506-b174-b8d1fefdce48 (72a3494c-40be-4506-b174-b8d1fefdce48): created successfully
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a39235d-6fe5-4bca-bb11-7a02810afdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Flow 'volume_create_manager' (ddc91a32-56c5-4a1b-ada2-08fc617ff2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c0dade-f7fc-4f28-825e-2c68d32b5a74]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6f8b37e6-d3f7-445b-88ca-9d46d1a6354c tempest-TestInstancesWithCinderVolumes-966562766 None] Created volume successfully.
Nov 05 04:25:51 devstack sudo[99796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c
Nov 05 04:25:51 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:51 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c" returned: 0 in 0.447s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:51 devstack sudo[99801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb 1G
Nov 05 04:25:51 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:52 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb 1G" returned: 0 in 0.705s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2dc24af-62ad-46c3-8edb-98e337e2748c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:52 devstack sudo[99806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2dc24af-62ad-46c3-8edb-98e337e2748c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb
Nov 05 04:25:52 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3a7876e6-6ca2-4b2f-b776-1835d7216d24 tempest-GroupsV320Test-1728704594 None] Group tempest-GroupsV320Test-Group-1550512866: creating
Nov 05 04:25:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3a7876e6-6ca2-4b2f-b776-1835d7216d24 tempest-GroupsV320Test-1728704594 None] Group tempest-GroupsV320Test-Group-1550512866: created successfully
Nov 05 04:25:52 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2dc24af-62ad-46c3-8edb-98e337e2748c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:52 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb is being set with open permissions: ugo+rw
Nov 05 04:25:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3a7876e6-6ca2-4b2f-b776-1835d7216d24 tempest-GroupsV320Test-1728704594 None] Create group completed successfully.
Nov 05 04:25:52 devstack sudo[99812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb
Nov 05 04:25:52 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:53 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb" returned: 0 in 0.280s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:53 devstack sudo[99815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.info
Nov 05 04:25:53 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:53 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.info" returned: 0 in 0.433s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:53 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.info is being set with open permissions: ugo+rw
Nov 05 04:25:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:53 devstack sudo[99833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.info
Nov 05 04:25:53 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:54 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.info" returned: 0 in 0.533s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-quobyte-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] snapshot: 12fbe005-8301-42e0-885e-71929010dffb, volume: abba8a6b-0ea0-4e5d-8af4-9b0b47994d21,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd089b07-2b82-4619-a282-a648c0371e5c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:54 devstack sudo[99882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb
Nov 05 04:25:54 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] Created reservations ['82072c43-0e5f-4d51-abed-0243a270637e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:54 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb" returned: 0 in 0.719s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2dc24af-62ad-46c3-8edb-98e337e2748c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:25:54 devstack sudo[99894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:25:54 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d9c9d8-5721-446e-9ae6-40230fd921bd]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:55 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c
Nov 05 04:25:55 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:55 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.510s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:55 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:25:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a57541cd-8812-452b-91a4-3438027390e6 tempest-GroupsV320Test-1728704594 None] Delete group completed successfully.
Nov 05 04:25:55 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c" returned: 0 in 0.779s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:25:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:25:55 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:25:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:55 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21
Nov 05 04:25:55 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:56 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD, size 20.69 MB, duration 5.67 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:25:56 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Image download 20.69 MB at 3.65 MB/s
Nov 05 04:25:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1b3c59-b94c-4c64-ad90-b46bc54fb4cd]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:56 devstack sudo[99918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD
Nov 05 04:25:56 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:57 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD" returned: 0 in 0.988s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:57 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Temporary image 538978c9-4594-46be-b3bf-0cfa4f2202af is fetched for user 94f572d7b65145bca2e707d92f064077. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:25:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f5ded4-d330-4038-8843-a59353f45aa2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:25:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:25:58 devstack sudo[99924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD
Nov 05 04:25:58 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:25:59 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root
Nov 05 04:25:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD" returned: 0 in 1.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:25:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:06 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" returned: 0 in 10.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c, size 1024.00 MB, duration 10.45 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:26:06 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Converted 1024.00 MB image at 97.98 MB/s
Nov 05 04:26:06 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21 is being set with open permissions: ugo+rw
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:06 devstack sudo[99932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21
Nov 05 04:26:06 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:06 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" released by "_copy_volume_from_snapshot" :: held 12.351s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=98,cinder:UPDATE=106,cinder:INSERT=31,cinder:DELETE=9 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-quobyte-12fbe005-8301-42e0-885e-71929010dffb" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-12fbe005-8301-42e0-885e-71929010dffb" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Deleting offline snapshot 12fbe005-8301-42e0-885e-71929010dffb of volume a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] snapshot_file for this snap is: volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d4b944-2d97-4295-8fd3-9038c7542e53]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:06 devstack sudo[99935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb
Nov 05 04:26:06 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:06 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb" returned: 0 in 0.433s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2dc24af-62ad-46c3-8edb-98e337e2748c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:07 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3fc616-9562-4c0f-8b25-c7a2728c06ba]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:07 devstack sudo[99940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c
Nov 05 04:26:07 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:07 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c" returned: 0 in 0.644s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:07 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb
Nov 05 04:26:07 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:07 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=92,cinder:INSERT=31,cinder:UPDATE=110,cinder:DELETE=8 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:26:08 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb" returned: 0 in 0.366s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:08 devstack sudo[99973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb
Nov 05 04:26:08 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:08 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c.12fbe005-8301-42e0-885e-71929010dffb" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-12fbe005-8301-42e0-885e-71929010dffb" released by "_delete_snapshot" :: held 1.852s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.279s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.203s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1475120746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49d93493-9ddf-45a9-839b-7bb0b768430e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3654216d42f24761b0936c6a3a3890ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:25:50Z,use_quota=True,user_id='94f572d7b65145bca2e707d92f064077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(365efae6-c480-4318-9679-a20e471fb283),volume_type_id=365efae6-c480-4318-9679-a20e471fb283)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Creating volume 49d93493-9ddf-45a9-839b-7bb0b768430e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:26:08 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:08 devstack sudo[99976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e 1073741824
Nov 05 04:26:08 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb93bd2b-6b17-4b42-ad5e-464ad6294501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21', 'volume_size': 1, 'source_volid': 'a2dc24af-62ad-46c3-8edb-98e337e2748c', 'source_volstatus': 'available'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad5d001-f5ca-4a9e-b7ea-e4b82420f25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Volume volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21 (abba8a6b-0ea0-4e5d-8af4-9b0b47994d21): created successfully
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad5d001-f5ca-4a9e-b7ea-e4b82420f25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (8450c9d4-9233-4c6c-85d8-636ee348ad12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7148f147-9d74-4b81-b9ec-6db19febec1a tempest-VolumesGetTest-612649850 None] Created volume successfully.
Nov 05 04:26:08 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e 1073741824" returned: 0 in 0.500s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:08 devstack sudo[99982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e
Nov 05 04:26:08 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:09 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:09 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Attempting download of 538978c9-4594-46be-b3bf-0cfa4f2202af ((None, [{'url': 'file:///opt/stack/data/glance/images/538978c9-4594-46be-b3bf-0cfa4f2202af', 'metadata': {}}])) to volume 49d93493-9ddf-45a9-839b-7bb0b768430e. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:26:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ef41cf-c228-46a3-9a6e-955550876694]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_538978c9-4594-46be-b3bf-0cfa4f2202af_ttcrhqsk {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:09 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_538978c9-4594-46be-b3bf-0cfa4f2202af_ttcrhqsk
Nov 05 04:26:09 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:09 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_538978c9-4594-46be-b3bf-0cfa4f2202af_ttcrhqsk" returned: 0 in 0.370s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_538978c9-4594-46be-b3bf-0cfa4f2202af_ttcrhqsk {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:09 devstack sudo[99990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_538978c9-4594-46be-b3bf-0cfa4f2202af_ttcrhqsk
Nov 05 04:26:09 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:10 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_538978c9-4594-46be-b3bf-0cfa4f2202af_ttcrhqsk" returned: 1 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_538978c9-4594-46be-b3bf-0cfa4f2202af_ttcrhqsk' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[824f2ab8-5836-4162-ab72-b144c45a9442]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:10 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD
Nov 05 04:26:10 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (0c07ae36-45b7-4ee0-8cc3-f325ecdf4604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730ea000-860f-40e6-87a0-f253d834a33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730ea000-860f-40e6-87a0-f253d834a33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1126852822',display_name='tempest-VolumesGetTest-Volume-859551135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa44db29-f70b-45ca-9c6d-d6965093e12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:10Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6f7832-e991-46c1-b24a-394f5cdc8599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6f7832-e991-46c1-b24a-394f5cdc8599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d6bb81-d183-4174-bdf4-d08a3bb6f603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88d6bb81-d183-4174-bdf4-d08a3bb6f603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa44db29-f70b-45ca-9c6d-d6965093e12a', 'volume_name': 'volume-aa44db29-f70b-45ca-9c6d-d6965093e12a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49deb0b-55f4-4ba7-ad09-e56de0bb212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d49deb0b-55f4-4ba7-ad09-e56de0bb212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b374352-7e0c-49f4-ad12-8b26411e66d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Volume aa44db29-f70b-45ca-9c6d-d6965093e12a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa44db29-f70b-45ca-9c6d-d6965093e12a', 'volume_size': 1}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1126852822',display_name='tempest-VolumesGetTest-Volume-859551135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa44db29-f70b-45ca-9c6d-d6965093e12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:10Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Creating volume aa44db29-f70b-45ca-9c6d-d6965093e12a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:26:10 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:10 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] 538978c9-4594-46be-b3bf-0cfa4f2202af was qcow2, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:26:10 devstack sudo[99999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a 1073741824
Nov 05 04:26:10 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:10 devstack sudo[100001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e
Nov 05 04:26:10 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:10 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a 1073741824" returned: 0 in 0.505s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:10 devstack sudo[100014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a
Nov 05 04:26:10 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:11 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:26:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b374352-7e0c-49f4-ad12-8b26411e66d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa44db29-f70b-45ca-9c6d-d6965093e12a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68710ccd-7099-40fa-abdf-5591b8d7501f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Volume volume-aa44db29-f70b-45ca-9c6d-d6965093e12a (aa44db29-f70b-45ca-9c6d-d6965093e12a): created successfully
Nov 05 04:26:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68710ccd-7099-40fa-abdf-5591b8d7501f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (0c07ae36-45b7-4ee0-8cc3-f325ecdf4604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f0643971-9bed-428b-9179-134ffe75de46 tempest-VolumesGetTest-612649850 None] Created volume successfully.
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-aa44db29-f70b-45ca-9c6d-d6965093e12a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Lock "cinder-aa44db29-f70b-45ca-9c6d-d6965093e12a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-quobyte-aa44db29-f70b-45ca-9c6d-d6965093e12a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-aa44db29-f70b-45ca-9c6d-d6965093e12a" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:12 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e" returned: 0 in 2.220s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_538978c9-4594-46be-b3bf-0cfa4f2202af_xmpnsy36devstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:26:12 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Converted 112.00 MB image at 50.44 MB/s
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e69be18-df23-49a6-8e98-b9661907dbe4]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:12 devstack sudo[100018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e 1G
Nov 05 04:26:12 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:12 devstack sudo[100019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a
Nov 05 04:26:12 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:12 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e 1G" returned: 0 in 0.339s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Downloaded image 538978c9-4594-46be-b3bf-0cfa4f2202af ((None, [{'url': 'file:///opt/stack/data/glance/images/538978c9-4594-46be-b3bf-0cfa4f2202af', 'metadata': {}}])) to volume 49d93493-9ddf-45a9-839b-7bb0b768430e successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Temporary image 538978c9-4594-46be-b3bf-0cfa4f2202af for user 94f572d7b65145bca2e707d92f064077 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:26:12 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Marking volume 49d93493-9ddf-45a9-839b-7bb0b768430e as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Copying metadata from image 538978c9-4594-46be-b3bf-0cfa4f2202af to 49d93493-9ddf-45a9-839b-7bb0b768430e. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Creating volume glance metadata for volume 49d93493-9ddf-45a9-839b-7bb0b768430e backed by image 538978c9-4594-46be-b3bf-0cfa4f2202af with: {'image_id': '538978c9-4594-46be-b3bf-0cfa4f2202af', 'image_name': 'tempest-scenario-img--1842391720', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:26:13 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a56f3b96-309d-4428-9414-f019b2bb25b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49d93493-9ddf-45a9-839b-7bb0b768430e', 'volume_size': 1, 'image_id': '538978c9-4594-46be-b3bf-0cfa4f2202af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/538978c9-4594-46be-b3bf-0cfa4f2202af', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1842391720', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3654216d42f24761b0936c6a3a3890ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '538978c9-4594-46be-b3bf-0cfa4f2202af', 'created_at': datetime.datetime(2026, 11, 5, 3, 25, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 25, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/538978c9-4594-46be-b3bf-0cfa4f2202af/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7ed1e80>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb05e6f-ef75-4f1e-a59f-e65484b98254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:13 devstack sudo[100029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a
Nov 05 04:26:13 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Volume volume-49d93493-9ddf-45a9-839b-7bb0b768430e (49d93493-9ddf-45a9-839b-7bb0b768430e): created successfully
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeb05e6f-ef75-4f1e-a59f-e65484b98254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Flow 'volume_create_manager' (22cb1391-2117-48c0-8b57-b50d6c6d1185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-deec43b0-a3c3-47cf-bbdb-86d2657c1035 tempest-TestInstancesWithCinderVolumes-966562766 None] Created volume successfully.
Nov 05 04:26:13 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-aa44db29-f70b-45ca-9c6d-d6965093e12a" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-aa44db29-f70b-45ca-9c6d-d6965093e12a" released by "delete_volume" :: held 0.750s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Created reservations ['5edc55b9-b875-46b0-8475-7b61a12fd8f6', '6eaac169-6692-4363-b0c2-b0b8f782ff0c', '3ce32c28-84f5-403c-b72a-1c58cf0344ec', 'e899ffee-e0cd-40fb-ab25-9dfbba43e930'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:13 devstack sudo[100032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:26:13 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:13 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.271s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:26:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Deleted volume successfully.
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Lock "cinder-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c4a36b1-4f97-4875-a9ae-d0837e231419 tempest-VolumesGetTest-612649850 None] Lock "cinder-aa44db29-f70b-45ca-9c6d-d6965093e12a-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-quobyte-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" acquired by "delete_volume" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38f30fd-bf53-4e58-b177-a31424eb497f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:14 devstack sudo[100037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21
Nov 05 04:26:14 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:14 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" returned: 0 in 0.404s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:14 devstack sudo[100042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21
Nov 05 04:26:14 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:14 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" returned: 0 in 0.329s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21" released by "delete_volume" :: held 0.797s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Created reservations ['9bcf20ef-d498-4016-81d2-bda2cdef17c8', '8dc8cdc1-5ed4-444e-b75b-196f3b799c97', 'c1cadd89-17d5-4157-acb4-099ec6b93ba8', '4b801551-3256-487d-b54e-ee7ab8ee03f6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:14 devstack sudo[100045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:26:14 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-a2dc24af-62ad-46c3-8edb-98e337e2748c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Lock "cinder-a2dc24af-62ad-46c3-8edb-98e337e2748c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-quobyte-a2dc24af-62ad-46c3-8edb-98e337e2748c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-a2dc24af-62ad-46c3-8edb-98e337e2748c" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ff6cb0-edfd-4e01-95cf-108787a1a047]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:15 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.524s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:26:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Deleted volume successfully.
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-45263b20-fed7-461b-a5e3-db00f6b3ae43 tempest-VolumesGetTest-612649850 None] Lock "cinder-abba8a6b-0ea0-4e5d-8af4-9b0b47994d21-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:15 devstack sudo[100048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c
Nov 05 04:26:15 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:15 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c" returned: 0 in 0.522s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:15 devstack sudo[100056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c
Nov 05 04:26:15 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:16 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2dc24af-62ad-46c3-8edb-98e337e2748c" returned: 0 in 0.392s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-a2dc24af-62ad-46c3-8edb-98e337e2748c" released by "delete_volume" :: held 1.045s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Flow 'volume_create_manager' (b968a9a8-e99c-4710-a10e-77a356796b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0389b6-453b-4ada-9c05-d9f82fa6d8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd0389b6-453b-4ada-9c05-d9f82fa6d8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-983705628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce6ea92-7a2f-473f-8c7a-e103512ec241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97845533128c4307b05558589367c156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:16Z,use_quota=True,user_id='55e6708df64141c59125ef79bdace2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caee8631-90e3-4898-84ca-a67345893d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caee8631-90e3-4898-84ca-a67345893d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82e147b-238f-493b-99c9-13d9149be148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82e147b-238f-493b-99c9-13d9149be148) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ce6ea92-7a2f-473f-8c7a-e103512ec241', 'volume_name': 'volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8756f3df-f22d-495f-a9d3-caa3579cf567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8756f3df-f22d-495f-a9d3-caa3579cf567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74cd5b8-e4f4-47c7-8bbd-ed024a9e6e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241', 'volume_size': 1}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-983705628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ce6ea92-7a2f-473f-8c7a-e103512ec241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97845533128c4307b05558589367c156',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:16Z,use_quota=True,user_id='55e6708df64141c59125ef79bdace2fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Creating volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:26:16 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Created reservations ['7af7880c-c61a-42d2-b0ec-712ae0ff241c', '35b7d206-1d33-4d9f-9a15-917f4f3bbd59', '80641eb0-1ca7-4f30-9a6c-655354d640a6', '1e10a844-b1bb-4be6-94b9-f2aa6551f7b0'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:16 devstack sudo[100059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 1073741824
Nov 05 04:26:16 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:16 devstack sudo[100061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:26:16 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:16 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:26:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Deleted volume successfully.
Nov 05 04:26:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-238548b2-cc40-43b2-ad39-08008b0176af tempest-VolumesGetTest-612649850 None] Lock "cinder-a2dc24af-62ad-46c3-8edb-98e337e2748c-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:17 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 1073741824" returned: 0 in 0.503s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:17 devstack sudo[100071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241
Nov 05 04:26:17 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:17 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a74cd5b8-e4f4-47c7-8bbd-ed024a9e6e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1459ce-ce45-4c94-9ac8-0b6234861daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Volume volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 (9ce6ea92-7a2f-473f-8c7a-e103512ec241): created successfully
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1459ce-ce45-4c94-9ac8-0b6234861daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Flow 'volume_create_manager' (b968a9a8-e99c-4710-a10e-77a356796b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-851be1ff-4381-4473-8f88-f93713c775f8 tempest-SnapshotsActionsTest-2034457712 None] Created volume successfully.
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-4443c17a-df7f-4603-be49-87e17ec74a0b req-32e6e603-f3a1-4c2e-9048-c427dea8f0f5 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-4443c17a-df7f-4603-be49-87e17ec74a0b req-32e6e603-f3a1-4c2e-9048-c427dea8f0f5 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-4443c17a-df7f-4603-be49-87e17ec74a0b req-32e6e603-f3a1-4c2e-9048-c427dea8f0f5 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-4443c17a-df7f-4603-be49-87e17ec74a0b req-32e6e603-f3a1-4c2e-9048-c427dea8f0f5 tempest-TestInstancesWithCinderVolumes-966562766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-49d93493-9ddf-45a9-839b-7bb0b768430e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3835962-6ce3-4463-b5e5-82c127adbb82', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:26:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-4443c17a-df7f-4603-be49-87e17ec74a0b req-32e6e603-f3a1-4c2e-9048-c427dea8f0f5 tempest-TestInstancesWithCinderVolumes-966562766 None] attachment_update completed successfully.
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (5a9d8a67-b6ab-49fa-bfb4-f7cd18a3123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b788ea-ff49-45d1-97b2-fdd7c647b231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b788ea-ff49-45d1-97b2-fdd7c647b231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-800105542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1ebee3-3523-4fd3-9bad-4afd184496ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:18Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d530b-872c-42c9-a31e-dfe29c24766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d530b-872c-42c9-a31e-dfe29c24766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d088c5-ddb8-4db6-8c07-f10d94b55fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Creating offline snapshot d3781e9b-992b-4564-97a7-d5ecdfe1a38c of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd48b93-7054-437a-a35b-2e91897fa6f7]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d088c5-ddb8-4db6-8c07-f10d94b55fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a1ebee3-3523-4fd3-9bad-4afd184496ba', 'volume_name': 'volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7ebdf40>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420951ae-8d38-451e-bc36-bb814674c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (420951ae-8d38-451e-bc36-bb814674c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951b1ec8-9365-4c22-93f5-6554a6dba794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Volume 2a1ebee3-3523-4fd3-9bad-4afd184496ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7ebdf40>}
Nov 05 04:26:18 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Trying to clone 2a1ebee3-3523-4fd3-9bad-4afd184496ba from image 6ded3d1d-d482-4fc8-985e-41c27b256803 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:26:18 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241
Nov 05 04:26:18 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:19 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:19 devstack sudo[100090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c 1G
Nov 05 04:26:19 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:26:19 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc134d13-46e7-4bdd-aa57-05336959ca48]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:19 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD
Nov 05 04:26:19 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:19 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 is fetched for user 8c21e0ae6956443db77f0294a0bf6bc7. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:26:19 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c 1G" returned: 0 in 0.602s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:19 devstack sudo[100104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:19 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e4faaa-eb93-4a70-8b6d-5bcb5e08220b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:19 devstack sudo[100106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD
Nov 05 04:26:19 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:20 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:20 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c is being set with open permissions: ugo+rw
Nov 05 04:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:20 devstack sudo[100137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:20 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:20 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:20 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.377s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:20 devstack sudo[100234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.info
Nov 05 04:26:20 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:20 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.info" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:20 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.info is being set with open permissions: ugo+rw
Nov 05 04:26:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:20 devstack sudo[100574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.info
Nov 05 04:26:20 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:21 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.info" returned: 0 in 0.468s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.800s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.225s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-800105542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1ebee3-3523-4fd3-9bad-4afd184496ba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:18Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Creating volume 2a1ebee3-3523-4fd3-9bad-4afd184496ba {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:26:21 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:26:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:21 devstack sudo[100596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba 1073741824
Nov 05 04:26:21 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b8f3c775-0e06-4994-8e9a-95738bd60608 tempest-SnapshotsActionsTest-2034457712 None] Create snapshot completed successfully
Nov 05 04:26:22 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba 1073741824" returned: 0 in 0.752s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:22 devstack sudo[100622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba
Nov 05 04:26:22 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:23 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba" returned: 0 in 0.698s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Attempting download of 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume 2a1ebee3-3523-4fd3-9bad-4afd184496ba. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[499617fe-77be-4346-9326-9f968cf4fb0a]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_66zxad_e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Creating offline snapshot bc2bc89c-554e-4798-9108-5bb572fc4d3f of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:26:23 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_66zxad_e
Nov 05 04:26:23 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d847d1-0256-405a-ae1c-b48678a45be3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Flow 'volume_create_manager' (61022c23-d883-4379-9294-fa94f9500f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:23 devstack sudo[100631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5514640-527b-429d-8bd9-a92b810b10e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:23 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5514640-527b-429d-8bd9-a92b810b10e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1607783736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f487db6-00bd-4833-946d-0cbd5ed24634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8f017982d6442b928958d3700b6a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:23Z,use_quota=True,user_id='227ec9daddf34f869ffe1e0fd8a7810c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0026d575-3668-458c-bf95-8fb2a911b1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0026d575-3668-458c-bf95-8fb2a911b1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcd111d-a158-495d-83cb-79f833a266ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcd111d-a158-495d-83cb-79f833a266ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f487db6-00bd-4833-946d-0cbd5ed24634', 'volume_name': 'volume-8f487db6-00bd-4833-946d-0cbd5ed24634', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef04081-9104-4224-a2e8-ce45f36da694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef04081-9104-4224-a2e8-ce45f36da694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57c551f-e768-4a65-88b7-0e024f79e037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:23 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Volume 8f487db6-00bd-4833-946d-0cbd5ed24634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f487db6-00bd-4833-946d-0cbd5ed24634', 'volume_size': 1}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:23 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_66zxad_e" returned: 0 in 0.524s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_66zxad_e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:23 devstack sudo[100635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_66zxad_e
Nov 05 04:26:23 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:23 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.443s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:23 devstack sudo[100641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f 1G
Nov 05 04:26:23 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:24 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_66zxad_e" returned: 1 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_66zxad_e' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad926590-1d20-48ee-8264-68e8e71d664f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:24 devstack sudo[100645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD
Nov 05 04:26:24 devstack sudo[100645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:24 devstack sudo[100645]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] 6ded3d1d-d482-4fc8-985e-41c27b256803 was qcow2, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:24 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f 1G" returned: 0 in 0.673s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:24 devstack sudo[100654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba
Nov 05 04:26:24 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:24 devstack sudo[100655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f
Nov 05 04:26:24 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:24 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:24 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f is being set with open permissions: ugo+rw
Nov 05 04:26:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:24 devstack sudo[100665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f
Nov 05 04:26:24 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:25 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f" returned: 0 in 0.302s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.946s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.648s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1607783736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f487db6-00bd-4833-946d-0cbd5ed24634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa8f017982d6442b928958d3700b6a74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:23Z,use_quota=True,user_id='227ec9daddf34f869ffe1e0fd8a7810c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Creating volume 8f487db6-00bd-4833-946d-0cbd5ed24634 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:26:25 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:26:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5c2215ad-d512-4458-9e9f-323c04b68716 tempest-SnapshotsActionsTest-2034457712 None] Create snapshot completed successfully
Nov 05 04:26:25 devstack sudo[100669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634 1073741824
Nov 05 04:26:25 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:26 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634 1073741824" returned: 0 in 0.767s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:26 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634
Nov 05 04:26:26 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:26 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634" returned: 0 in 0.405s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57c551f-e768-4a65-88b7-0e024f79e037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f487db6-00bd-4833-946d-0cbd5ed24634', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1cbf24-9920-4886-8d0c-70d35f14eee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:26 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Volume volume-8f487db6-00bd-4833-946d-0cbd5ed24634 (8f487db6-00bd-4833-946d-0cbd5ed24634): created successfully
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1cbf24-9920-4886-8d0c-70d35f14eee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Flow 'volume_create_manager' (61022c23-d883-4379-9294-fa94f9500f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-bc2bc89c-554e-4798-9108-5bb572fc4d3f-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6123bb00-c293-4b5e-8709-9ba46dc02fe5 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Created volume successfully.
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-bc2bc89c-554e-4798-9108-5bb572fc4d3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-quobyte-bc2bc89c-554e-4798-9108-5bb572fc4d3f" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-bc2bc89c-554e-4798-9108-5bb572fc4d3f" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Deleting offline snapshot bc2bc89c-554e-4798-9108-5bb572fc4d3f of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] snapshot_file for this snap is: volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e7e428-db29-4c5f-84bd-7621db699a58]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:27 devstack sudo[100679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f
Nov 05 04:26:27 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:27 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba" returned: 0 in 2.737s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_7gn_snd7devstack@QuobyteHD, size 112.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:26:27 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Converted 112.00 MB image at 40.90 MB/s
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:27 devstack sudo[100681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba 1G
Nov 05 04:26:27 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:27 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f" returned: 0 in 0.591s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccfe766-0e6b-4ce2-82c4-4107ac707418]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:27 devstack sudo[100688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:27 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:27 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba 1G" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Downloaded image 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume 2a1ebee3-3523-4fd3-9bad-4afd184496ba successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 for user 8c21e0ae6956443db77f0294a0bf6bc7 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Marking volume 2a1ebee3-3523-4fd3-9bad-4afd184496ba as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Copying metadata from image 6ded3d1d-d482-4fc8-985e-41c27b256803 to 2a1ebee3-3523-4fd3-9bad-4afd184496ba. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Creating volume glance metadata for volume 2a1ebee3-3523-4fd3-9bad-4afd184496ba backed by image 6ded3d1d-d482-4fc8-985e-41c27b256803 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951b1ec8-9365-4c22-93f5-6554a6dba794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7ebdf40>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd63fcb9-58a1-401a-ba3a-d983dd0cd834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Volume volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba (2a1ebee3-3523-4fd3-9bad-4afd184496ba): created successfully
Nov 05 04:26:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd63fcb9-58a1-401a-ba3a-d983dd0cd834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (5a9d8a67-b6ab-49fa-bfb4-f7cd18a3123d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-aeec5b42-adfd-4260-9fff-2d0e6c970d31 tempest-VolumesGetTest-612649850 None] Created volume successfully.
Nov 05 04:26:28 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.681s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:28 devstack sudo[100698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f
Nov 05 04:26:28 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:29 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:26:29 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:29 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f" returned: 0 in 0.973s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:29 devstack sudo[100741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f
Nov 05 04:26:29 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:29 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.629s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-f6de519e-9ef7-43d3-980b-73d9df0a837f req-8ce8eeb2-cfed-4985-b47e-e3d9aef7f465 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-f6de519e-9ef7-43d3-980b-73d9df0a837f req-8ce8eeb2-cfed-4985-b47e-e3d9aef7f465 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-f6de519e-9ef7-43d3-980b-73d9df0a837f req-8ce8eeb2-cfed-4985-b47e-e3d9aef7f465 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-f6de519e-9ef7-43d3-980b-73d9df0a837f req-8ce8eeb2-cfed-4985-b47e-e3d9aef7f465 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-8f487db6-00bd-4833-946d-0cbd5ed24634', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09458099-0f45-430c-b22c-36a87b4a5d28', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:26:29 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.bc2bc89c-554e-4798-9108-5bb572fc4d3f" returned: 0 in 0.805s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-f6de519e-9ef7-43d3-980b-73d9df0a837f req-8ce8eeb2-cfed-4985-b47e-e3d9aef7f465 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] attachment_update completed successfully.
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-bc2bc89c-554e-4798-9108-5bb572fc4d3f" released by "_delete_snapshot" :: held 3.232s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (2c669245-85d7-436e-b40b-c0bb3f6351b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e27dd9c-f794-4636-9ac4-86109704384a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" released by "delete_snapshot" :: held 3.369s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e27dd9c-f794-4636-9ac4-86109704384a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119369169',display_name='tempest-VolumesGetTest-Volume-2136875904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5eb23d-768e-4477-932e-b70896c07bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:30Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15fa942-70af-4faf-92f5-769f9d3d8416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15fa942-70af-4faf-92f5-769f9d3d8416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b612497-82fc-4f15-a033-66c1cd9a344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b612497-82fc-4f15-a033-66c1cd9a344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5eb23d-768e-4477-932e-b70896c07bb7', 'volume_name': 'volume-8d5eb23d-768e-4477-932e-b70896c07bb7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b545211-96d5-4ac5-8c5a-4c0ae6a976cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b545211-96d5-4ac5-8c5a-4c0ae6a976cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88287bed-88a9-489e-8309-d945a2b6877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:30 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Volume 8d5eb23d-768e-4477-932e-b70896c07bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5eb23d-768e-4477-932e-b70896c07bb7', 'volume_size': 1}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119369169',display_name='tempest-VolumesGetTest-Volume-2136875904',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5eb23d-768e-4477-932e-b70896c07bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a310d05dbc5b4fe5b6bc3126139d43cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:30Z,use_quota=True,user_id='8c21e0ae6956443db77f0294a0bf6bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Creating volume 8d5eb23d-768e-4477-932e-b70896c07bb7 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:26:30 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:30 devstack sudo[100758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7 1073741824
Nov 05 04:26:30 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Created reservations ['4fd4a681-2b67-4965-9fbd-818f2d7a2775', '725e80ba-6266-413e-9d20-55775f49191e', '227a69b1-2056-4693-8e76-3c1a2ef68d13', '29439bf6-638f-422c-a883-255583aa2182'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:30 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Delete snapshot completed successfully.
Nov 05 04:26:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-747fa804-5a68-45b0-8bb1-026e1a606c87 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-bc2bc89c-554e-4798-9108-5bb572fc4d3f-delete_snapshot" released by "delete_snapshot" :: held 3.834s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:31 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7 1073741824" returned: 0 in 0.697s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:31 devstack sudo[100766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7
Nov 05 04:26:31 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:31 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88287bed-88a9-489e-8309-d945a2b6877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5eb23d-768e-4477-932e-b70896c07bb7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cced0642-2745-418a-8c4a-e77629536904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:31 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Volume volume-8d5eb23d-768e-4477-932e-b70896c07bb7 (8d5eb23d-768e-4477-932e-b70896c07bb7): created successfully
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cced0642-2745-418a-8c4a-e77629536904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Flow 'volume_create_manager' (2c669245-85d7-436e-b40b-c0bb3f6351b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8887446a-f51d-4342-bb29-14da939b7bae tempest-VolumesGetTest-612649850 None] Created volume successfully.
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Creating offline snapshot 904522c9-f8a7-4213-bdb2-4d82b0b37085 of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[95922ac1-3ef2-4147-a7d3-39e595f969b2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:32 devstack sudo[100769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:32 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-8d5eb23d-768e-4477-932e-b70896c07bb7-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:32 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.793s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Lock "cinder-8d5eb23d-768e-4477-932e-b70896c07bb7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:32 devstack sudo[100774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 1G
Nov 05 04:26:32 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-quobyte-8d5eb23d-768e-4477-932e-b70896c07bb7" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-8d5eb23d-768e-4477-932e-b70896c07bb7" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:32 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[987e7b5e-a2af-424c-9b7c-13cd85e653a5]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:33 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7
Nov 05 04:26:33 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:33 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7" returned: 0 in 0.535s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:33 devstack sudo[100784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7
Nov 05 04:26:33 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:33 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 1G" returned: 0 in 0.921s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:33 devstack sudo[100787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085
Nov 05 04:26:33 devstack sudo[100787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:33 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8d5eb23d-768e-4477-932e-b70896c07bb7" returned: 0 in 0.421s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:33 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-8d5eb23d-768e-4477-932e-b70896c07bb7" released by "delete_volume" :: held 1.036s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-fc291913-5eaf-467a-9d9e-5c8edbded69f req-ad342efd-4600-49c9-9732-bc2a266922fd tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Terminate volume connection completed successfully.
Nov 05 04:26:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-fc291913-5eaf-467a-9d9e-5c8edbded69f req-ad342efd-4600-49c9-9732-bc2a266922fd tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Deleting attachment 09458099-0f45-430c-b22c-36a87b4a5d28. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:26:33 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Created reservations ['30c05b85-c968-45d9-b63b-339d478a7506', 'd0edcb02-e6f4-4986-8588-c6e6bfc713fe', '4833a2b7-6417-481f-b74e-9112175c0497', '63c9efe7-80dd-40f1-a757-202cf50c6aa5'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:34 devstack sudo[100787]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:34 devstack sudo[100795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:26:34 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085" returned: 0 in 0.563s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:34 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 is being set with open permissions: ugo+rw
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:34 devstack sudo[100797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085
Nov 05 04:26:34 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-2a1ebee3-3523-4fd3-9bad-4afd184496ba-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Lock "cinder-2a1ebee3-3523-4fd3-9bad-4afd184496ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Acquiring lock "cinder-quobyte-2a1ebee3-3523-4fd3-9bad-4afd184496ba" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-2a1ebee3-3523-4fd3-9bad-4afd184496ba" acquired by "delete_volume" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c64f68-0eaf-4572-8eec-cfb4067ee680]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:34 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.554s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:26:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Deleted volume successfully.
Nov 05 04:26:34 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085" returned: 0 in 0.509s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.964s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c6219b7d-cbf5-4bd8-9368-77b1caf24555 tempest-VolumesGetTest-612649850 None] Lock "cinder-8d5eb23d-768e-4477-932e-b70896c07bb7-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e42cb536-19aa-48c4-9ba6-24a845b75625 tempest-SnapshotsActionsTest-2034457712 None] Create snapshot completed successfully
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Acquiring lock "cinder-8f487db6-00bd-4833-946d-0cbd5ed24634-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "cinder-8f487db6-00bd-4833-946d-0cbd5ed24634-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:34 devstack sudo[100800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba
Nov 05 04:26:34 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Acquiring lock "cinder-quobyte-8f487db6-00bd-4833-946d-0cbd5ed24634" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "cinder-quobyte-8f487db6-00bd-4833-946d-0cbd5ed24634" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0cb742-5681-4a71-9990-16bf92ed4c23]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:35 devstack sudo[100804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634
Nov 05 04:26:35 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-904522c9-f8a7-4213-bdb2-4d82b0b37085-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-904522c9-f8a7-4213-bdb2-4d82b0b37085-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-quobyte-904522c9-f8a7-4213-bdb2-4d82b0b37085" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:35 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba" returned: 0 in 0.902s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-904522c9-f8a7-4213-bdb2-4d82b0b37085" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Deleting offline snapshot 904522c9-f8a7-4213-bdb2-4d82b0b37085 of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:26:35 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] snapshot_file for this snap is: volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:26:35 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c902ac0c-7edc-4ee2-85a8-b9694234da6f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:35 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634" returned: 0 in 0.681s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:35 devstack sudo[100811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085
Nov 05 04:26:35 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:35 devstack sudo[100815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634
Nov 05 04:26:35 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:35 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-2a1ebee3-3523-4fd3-9bad-4afd184496ba" returned: 0 in 0.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Lock "cinder-quobyte-2a1ebee3-3523-4fd3-9bad-4afd184496ba" released by "delete_volume" :: held 1.374s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Created reservations ['57219a61-59ea-4105-981e-6b883f61d6f0', '7cbabfb5-5e4e-4f1f-af60-0f42c0cd3e34', '9b3c0639-8a54-4bc8-a1f3-45f9c65db2c2', '795372a4-3807-41df-abc1-1d1294b827f8'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:36 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8f487db6-00bd-4833-946d-0cbd5ed24634" returned: 0 in 0.445s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:36 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085" returned: 0 in 0.614s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:36 devstack sudo[100823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:26:36 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "cinder-quobyte-8f487db6-00bd-4833-946d-0cbd5ed24634" released by "delete_volume" :: held 1.247s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7113c4-a912-46ba-9305-516ec9daa211]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Created reservations ['98bd2be5-c667-414a-b594-16d34b23e89c', 'e5976bc7-579b-4def-ae82-0d261bb540c9', 'aecb06d7-878a-40c4-82f1-abbddbd83ae6', 'd8affc43-3bf1-4e32-afbe-97ae0d349f0d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:36 devstack sudo[100825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:36 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:36 devstack sudo[100827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:26:36 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:36 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.353s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:26:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Deleted volume successfully.
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0512a790-66f9-4b6f-84e3-435639edc719 tempest-VolumesGetTest-612649850 None] Lock "cinder-2a1ebee3-3523-4fd3-9bad-4afd184496ba-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:36 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.420s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:36 devstack sudo[100833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085
Nov 05 04:26:36 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:36 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:26:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Deleted volume successfully.
Nov 05 04:26:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4f27347d-bb71-40b6-905f-e6bef6733565 tempest-TestServerVolumeAttachScenarioOldVersion-360032287 None] Lock "cinder-8f487db6-00bd-4833-946d-0cbd5ed24634-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:37 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:37 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085
Nov 05 04:26:37 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:37 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.904522c9-f8a7-4213-bdb2-4d82b0b37085" returned: 0 in 0.346s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-904522c9-f8a7-4213-bdb2-4d82b0b37085" released by "_delete_snapshot" :: held 1.967s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" released by "delete_snapshot" :: held 2.048s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:37 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Created reservations ['5e63e89d-7fe1-4b89-a55f-94dda426ce01', '78c95105-e42a-4a9a-b45a-64c69d9cb682', '7f9b02ce-1060-4678-9aa3-b1a3d530e70b', '41eefad2-1fd9-4017-9d8d-29b94996c35f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Delete snapshot completed successfully.
Nov 05 04:26:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-757a3c04-8d0e-49bf-bc0e-026b36481cd6 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-904522c9-f8a7-4213-bdb2-4d82b0b37085-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Creating offline snapshot 7f079a70-b268-4729-851a-0c9fa22d0600 of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:26:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68dd3d6-9909-42c3-bbe6-302e5a725956]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:39 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:39 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:39 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.554s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:39 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 1G
Nov 05 04:26:39 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:40 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 1G" returned: 0 in 0.805s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:40 devstack sudo[100904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600
Nov 05 04:26:40 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:41 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600" returned: 0 in 0.424s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:41 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 is being set with open permissions: ugo+rw
Nov 05 04:26:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:41 devstack sudo[100922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600
Nov 05 04:26:41 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:41 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fbdb1220-20bd-42d9-8ba9-1c4443b609db tempest-SnapshotsActionsTest-2034457712 None] Create snapshot completed successfully
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-7f079a70-b268-4729-851a-0c9fa22d0600-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-7f079a70-b268-4729-851a-0c9fa22d0600-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Flow 'volume_create_manager' (417291fc-1191-4601-9ee7-5cd56a89b970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0b87d2-bab4-4d07-aa16-852ebc71cef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-quobyte-7f079a70-b268-4729-851a-0c9fa22d0600" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0b87d2-bab4-4d07-aa16-852ebc71cef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-876244985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32249ebf-ee57-43c4-8772-8b6951f79c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7678367bf74c3c91de409c2c12e2b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:42Z,use_quota=True,user_id='e7605da85fe04c83a60e856585a2f424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1dc462-5e74-4855-9ccd-f09c1c785abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f1dc462-5e74-4855-9ccd-f09c1c785abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ba1e55-64e5-4dad-8672-e141cf1e08db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ba1e55-64e5-4dad-8672-e141cf1e08db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32249ebf-ee57-43c4-8772-8b6951f79c93', 'volume_name': 'volume-32249ebf-ee57-43c4-8772-8b6951f79c93', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9984f49c-2156-45d0-b480-2bf0f28b7031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9984f49c-2156-45d0-b480-2bf0f28b7031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455e4125-2f5d-4527-b196-8bfae59a3078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Volume 32249ebf-ee57-43c4-8772-8b6951f79c93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32249ebf-ee57-43c4-8772-8b6951f79c93', 'volume_size': 1}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-876244985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32249ebf-ee57-43c4-8772-8b6951f79c93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b7678367bf74c3c91de409c2c12e2b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:26:42Z,use_quota=True,user_id='e7605da85fe04c83a60e856585a2f424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Creating volume 32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:26:42 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:42 devstack sudo[100925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93 1073741824
Nov 05 04:26:42 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-7f079a70-b268-4729-851a-0c9fa22d0600" acquired by "_delete_snapshot" :: waited 0.097s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Deleting offline snapshot 7f079a70-b268-4729-851a-0c9fa22d0600 of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] snapshot_file for this snap is: volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5183fa67-b581-4458-9d08-ddcb7e55379f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:42 devstack sudo[100927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600
Nov 05 04:26:42 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:43 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93 1073741824" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:43 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600" returned: 0 in 0.410s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ca52ca-7b5c-436a-85ac-236401d40749]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:43 devstack sudo[100937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93
Nov 05 04:26:43 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:43 devstack sudo[100936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:43 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:43 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (455e4125-2f5d-4527-b196-8bfae59a3078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32249ebf-ee57-43c4-8772-8b6951f79c93', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa7970f-37eb-4de3-b3e5-13deefb67d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:26:43 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Volume volume-32249ebf-ee57-43c4-8772-8b6951f79c93 (32249ebf-ee57-43c4-8772-8b6951f79c93): created successfully
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa7970f-37eb-4de3-b3e5-13deefb67d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Flow 'volume_create_manager' (417291fc-1191-4601-9ee7-5cd56a89b970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:26:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9c21fe88-4ac5-4061-97bf-9539e733f30e tempest-VolumesSnapshotListTestJSON-864756413 None] Created volume successfully.
Nov 05 04:26:43 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:43 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600
Nov 05 04:26:43 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:43 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600" returned: 0 in 0.405s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:44 devstack sudo[100949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600
Nov 05 04:26:44 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:44 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.7f079a70-b268-4729-851a-0c9fa22d0600" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-7f079a70-b268-4729-851a-0c9fa22d0600" released by "_delete_snapshot" :: held 1.608s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" released by "delete_snapshot" :: held 1.715s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Created reservations ['6d3622c2-3d95-4efa-a1ca-6d577b8ad553', '4f48ab76-4960-4ddc-83bc-78b680efc42c', '9268aa2e-392a-4848-8de2-77a846c7004c', '0186948d-80a5-41f7-af71-2e0bd2092859'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Delete snapshot completed successfully.
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f88ad979-6770-41eb-88db-9b05892e7187 tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-7f079a70-b268-4729-851a-0c9fa22d0600-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Creating offline snapshot ea3081ba-6214-4b90-bbb6-5de6c05dce4b of volume 32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c3b722-884d-4c01-a86a-88f2234d0aee]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:45 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93
Nov 05 04:26:45 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:45 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:45 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b 1G
Nov 05 04:26:45 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:45 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b 1G" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32249ebf-ee57-43c4-8772-8b6951f79c93 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:45 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32249ebf-ee57-43c4-8772-8b6951f79c93 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b
Nov 05 04:26:45 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:46 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32249ebf-ee57-43c4-8772-8b6951f79c93 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:46 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b is being set with open permissions: ugo+rw
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:46 devstack sudo[100968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b
Nov 05 04:26:46 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:46 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:46 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.info
Nov 05 04:26:46 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:46 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.info" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:46 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.info is being set with open permissions: ugo+rw
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:46 devstack sudo[100974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.info
Nov 05 04:26:46 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:46 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.info" returned: 0 in 0.329s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.884s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Creating offline snapshot 736da887-6926-403a-8514-af9b6d293f5b of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:26:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5efbea92-70ff-4db2-bd1f-eba0d37295f8 tempest-VolumesSnapshotListTestJSON-864756413 None] Create snapshot completed successfully
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c41cebe-c00f-4f29-b357-f0b51456972c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:47 devstack sudo[100977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:47 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:47 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:47 devstack sudo[100982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b 1G
Nov 05 04:26:47 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:47 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b 1G" returned: 0 in 0.572s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:47 devstack sudo[100989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b
Nov 05 04:26:47 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:48 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:48 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b is being set with open permissions: ugo+rw
Nov 05 04:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:48 devstack sudo[100995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b
Nov 05 04:26:48 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:48 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b" returned: 0 in 0.314s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.531s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Creating offline snapshot 1e634117-4693-444c-971c-bbfad3a60e23 of volume 32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:26:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9dba2735-9095-4316-9d91-1b77c8edaf0b tempest-SnapshotsActionsTest-2034457712 None] Create snapshot completed successfully
Nov 05 04:26:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[18724767-6e17-4f5f-a8f2-046d94e0e7f1]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:48 devstack sudo[100998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b
Nov 05 04:26:48 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:49 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b" returned: 0 in 0.432s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32249ebf-ee57-43c4-8772-8b6951f79c93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:49 devstack sudo[101003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 1G
Nov 05 04:26:49 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-736da887-6926-403a-8514-af9b6d293f5b-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-736da887-6926-403a-8514-af9b6d293f5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Acquiring lock "cinder-quobyte-736da887-6926-403a-8514-af9b6d293f5b" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-736da887-6926-403a-8514-af9b6d293f5b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Deleting offline snapshot 736da887-6926-403a-8514-af9b6d293f5b of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] snapshot_file for this snap is: volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5746bde4-7914-4a31-9a8b-1a158fddd6e7]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:49 devstack sudo[101007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b
Nov 05 04:26:49 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:49 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 1G" returned: 0 in 0.639s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:49 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b" returned: 0 in 0.448s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:49 devstack sudo[101016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23
Nov 05 04:26:49 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f255946b-8b15-42bf-ba1e-8b292b44eed0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:50 devstack sudo[101018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:50 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:50 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:50 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 is being set with open permissions: ugo+rw
Nov 05 04:26:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:50 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23
Nov 05 04:26:50 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:50 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:50 devstack sudo[101028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b
Nov 05 04:26:50 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:50 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23" returned: 0 in 0.336s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-aeb77710-7551-4251-bbe9-25657bb06e10 tempest-VolumesSnapshotListTestJSON-864756413 None] Create snapshot completed successfully
Nov 05 04:26:50 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b" returned: 0 in 0.473s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:50 devstack sudo[101035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b
Nov 05 04:26:50 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:51 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.736da887-6926-403a-8514-af9b6d293f5b" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-736da887-6926-403a-8514-af9b6d293f5b" released by "_delete_snapshot" :: held 1.701s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" released by "delete_snapshot" :: held 1.733s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Created reservations ['5d9d4a1b-768b-42b1-ba6d-5b690e4d7df3', 'd8119269-4c13-4005-9a1a-f04186574755', '48630056-69c7-4d27-827a-37bd22cd0b76', '05c35296-b026-47aa-bf46-58dcb7a693cb'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Delete snapshot completed successfully.
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9317ad08-bc3a-498b-9b89-6ca019780d7e tempest-SnapshotsActionsTest-804360917 None] Lock "cinder-736da887-6926-403a-8514-af9b6d293f5b-delete_snapshot" released by "delete_snapshot" :: held 1.879s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Creating offline snapshot 6d34d432-fcdf-45c8-8f73-82143cd7dfd2 of volume 32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a40b52-c655-43e6-ac6b-76dc16bc06ff]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:51 devstack sudo[101038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23
Nov 05 04:26:51 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:52 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32249ebf-ee57-43c4-8772-8b6951f79c93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:52 devstack sudo[101044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 1G
Nov 05 04:26:52 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "cinder-d3781e9b-992b-4564-97a7-d5ecdfe1a38c-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-d3781e9b-992b-4564-97a7-d5ecdfe1a38c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "cinder-quobyte-d3781e9b-992b-4564-97a7-d5ecdfe1a38c" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-quobyte-d3781e9b-992b-4564-97a7-d5ecdfe1a38c" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Deleting offline snapshot d3781e9b-992b-4564-97a7-d5ecdfe1a38c of volume 9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] snapshot_file for this snap is: volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb902c6-743d-45d0-b27f-95dbaa3da063]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:52 devstack sudo[101049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:52 devstack sudo[101049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:52 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 1G" returned: 0 in 0.563s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:52 devstack sudo[101053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2
Nov 05 04:26:52 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:52 devstack sudo[101049]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.477s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[364aabe8-2f54-427c-970a-d7634b8195e3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:52 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2" returned: 0 in 0.367s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:52 devstack sudo[101059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241
Nov 05 04:26:52 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:52 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 is being set with open permissions: ugo+rw
Nov 05 04:26:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:53 devstack sudo[101064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2
Nov 05 04:26:53 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:53 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241" returned: 0 in 0.368s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:53 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2" returned: 0 in 0.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:53 devstack sudo[101070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:53 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.804s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-59e7befb-16ea-4056-bb31-006f7f04b708 tempest-VolumesSnapshotListTestJSON-864756413 None] Create snapshot completed successfully
Nov 05 04:26:53 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:53 devstack sudo[101075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c
Nov 05 04:26:53 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:53 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241.d3781e9b-992b-4564-97a7-d5ecdfe1a38c" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-quobyte-d3781e9b-992b-4564-97a7-d5ecdfe1a38c" released by "_delete_snapshot" :: held 1.661s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" released by "delete_snapshot" :: held 1.696s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Created reservations ['ab343f71-2770-4f87-a457-54c158c7d991', 'f6fbd76d-06b6-4033-b7a2-3cec5aed6374', 'fc629168-2d72-4036-94b6-972b812cbbcb', '10a63897-133b-464b-b02c-b3fa1b947a46'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Delete snapshot completed successfully.
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0b638a55-9151-4c5d-80b7-d1e630bc3b01 tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-d3781e9b-992b-4564-97a7-d5ecdfe1a38c-delete_snapshot" released by "delete_snapshot" :: held 1.873s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "cinder-9ce6ea92-7a2f-473f-8c7a-e103512ec241-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-9ce6ea92-7a2f-473f-8c7a-e103512ec241-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5700f8e-9139-4157-886c-f5831a222697]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:54 devstack sudo[101078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241
Nov 05 04:26:54 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-6d34d432-fcdf-45c8-8f73-82143cd7dfd2-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-6d34d432-fcdf-45c8-8f73-82143cd7dfd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-quobyte-6d34d432-fcdf-45c8-8f73-82143cd7dfd2" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-6d34d432-fcdf-45c8-8f73-82143cd7dfd2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Deleting offline snapshot 6d34d432-fcdf-45c8-8f73-82143cd7dfd2 of volume 32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] snapshot_file for this snap is: volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4612bfcb-9b24-41b9-af20-7846d3b04908]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:55 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241" returned: 0 in 0.473s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:55 devstack sudo[101082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2
Nov 05 04:26:55 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:55 devstack sudo[101087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241
Nov 05 04:26:55 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:55 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9ce6ea92-7a2f-473f-8c7a-e103512ec241" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:55 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2" returned: 0 in 0.429s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32249ebf-ee57-43c4-8772-8b6951f79c93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-quobyte-9ce6ea92-7a2f-473f-8c7a-e103512ec241" released by "delete_volume" :: held 0.842s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd466d5f-bbf2-45af-b918-4035c6adafaa]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Created reservations ['165a028d-a0be-4740-a6be-97c0f14c8063', 'dcad0466-679c-4bfe-b7bc-e8d20305f9fc', 'a2a00582-4cb8-4161-9392-e2018338bfe7', 'f30d0564-d820-47d7-aeb0-59dcc0433e9d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:26:55 devstack sudo[101095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23
Nov 05 04:26:55 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:55 devstack sudo[101097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:26:55 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:56 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.360s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:26:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Deleted volume successfully.
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc8f06d9-a527-4b9c-af7d-a7fa2edbc0ed tempest-SnapshotsActionsTest-2034457712 None] Lock "cinder-9ce6ea92-7a2f-473f-8c7a-e103512ec241-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:56 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23" returned: 0 in 0.586s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32249ebf-ee57-43c4-8772-8b6951f79c93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:56 devstack sudo[101107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2
Nov 05 04:26:56 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-088dcae6-e57b-4960-ba49-e48cc67608ac req-07b061aa-2e7d-4795-baf5-e15e475c2e33 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-088dcae6-e57b-4960-ba49-e48cc67608ac req-07b061aa-2e7d-4795-baf5-e15e475c2e33 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-088dcae6-e57b-4960-ba49-e48cc67608ac req-07b061aa-2e7d-4795-baf5-e15e475c2e33 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:26:56 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2" returned: 0 in 0.622s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-088dcae6-e57b-4960-ba49-e48cc67608ac req-07b061aa-2e7d-4795-baf5-e15e475c2e33 tempest-TestInstancesWithCinderVolumes-966562766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-58a9b47d-e2e7-4a56-bbe5-38897f827509', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebfa598d-f5b5-4ee7-b891-65dec3747deb', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:26:56 devstack sudo[101122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2
Nov 05 04:26:56 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-088dcae6-e57b-4960-ba49-e48cc67608ac req-07b061aa-2e7d-4795-baf5-e15e475c2e33 tempest-TestInstancesWithCinderVolumes-966562766 None] attachment_update completed successfully.
Nov 05 04:26:57 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.6d34d432-fcdf-45c8-8f73-82143cd7dfd2" returned: 0 in 0.351s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-6d34d432-fcdf-45c8-8f73-82143cd7dfd2" released by "_delete_snapshot" :: held 2.123s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" released by "delete_snapshot" :: held 2.159s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:57 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Created reservations ['bf258a29-0d1f-44b8-9445-7b9d39857d70', '23477437-0559-4b61-8827-815858633a59', 'be8e3dc1-2029-4944-be30-c7a03821f8e3', 'ad1de7b4-a7fb-4a8c-80dc-1edb5d8c67f9'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:26:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Delete snapshot completed successfully.
Nov 05 04:26:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c710f28e-e7f8-405d-8a6c-8824733d9244 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-6d34d432-fcdf-45c8-8f73-82143cd7dfd2-delete_snapshot" released by "delete_snapshot" :: held 2.509s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-1e634117-4693-444c-971c-bbfad3a60e23-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-1e634117-4693-444c-971c-bbfad3a60e23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-quobyte-1e634117-4693-444c-971c-bbfad3a60e23" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-1e634117-4693-444c-971c-bbfad3a60e23" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Deleting offline snapshot 1e634117-4693-444c-971c-bbfad3a60e23 of volume 32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] snapshot_file for this snap is: volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e34d590-cb36-4dcd-b581-7048130f35f5]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:58 devstack sudo[101127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23
Nov 05 04:26:58 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:58 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23" returned: 0 in 0.454s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32249ebf-ee57-43c4-8772-8b6951f79c93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea253443-5e71-4fad-a9b2-73981ae46790]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:26:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:58 devstack sudo[101134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b
Nov 05 04:26:58 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:59 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b" returned: 0 in 0.463s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32249ebf-ee57-43c4-8772-8b6951f79c93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:26:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:59 devstack sudo[101143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23
Nov 05 04:26:59 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:26:59 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root
Nov 05 04:26:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23" returned: 0 in 0.526s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:26:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:26:59 devstack sudo[101152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23
Nov 05 04:26:59 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:00 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.1e634117-4693-444c-971c-bbfad3a60e23" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-1e634117-4693-444c-971c-bbfad3a60e23" released by "_delete_snapshot" :: held 1.988s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" released by "delete_snapshot" :: held 2.026s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-95a6bf3d-9091-4a83-8b68-83453f5c636d req-ee689f72-d582-4c5b-88e1-9efe7808f142 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-95a6bf3d-9091-4a83-8b68-83453f5c636d req-ee689f72-d582-4c5b-88e1-9efe7808f142 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-95a6bf3d-9091-4a83-8b68-83453f5c636d req-ee689f72-d582-4c5b-88e1-9efe7808f142 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-95a6bf3d-9091-4a83-8b68-83453f5c636d req-ee689f72-d582-4c5b-88e1-9efe7808f142 tempest-TestInstancesWithCinderVolumes-966562766 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-72a3494c-40be-4506-b174-b8d1fefdce48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbdc7660-4e8e-455b-adeb-6166ec1bf1e5', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:27:00 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Created reservations ['28b634c6-7726-45ab-9d3c-55b50c7a2fb0', '38c61f7d-da07-4345-b2c8-263713095cf6', '689e09a2-f493-4428-87fd-c38cff294b4c', 'a4f21f97-df65-45fc-9d25-8432c8148a9d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-95a6bf3d-9091-4a83-8b68-83453f5c636d req-ee689f72-d582-4c5b-88e1-9efe7808f142 tempest-TestInstancesWithCinderVolumes-966562766 None] attachment_update completed successfully.
Nov 05 04:27:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Delete snapshot completed successfully.
Nov 05 04:27:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e7928a16-be85-43c4-b755-c49eeb1f45ec tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-1e634117-4693-444c-971c-bbfad3a60e23-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-ea3081ba-6214-4b90-bbb6-5de6c05dce4b-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-ea3081ba-6214-4b90-bbb6-5de6c05dce4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-quobyte-ea3081ba-6214-4b90-bbb6-5de6c05dce4b" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-ea3081ba-6214-4b90-bbb6-5de6c05dce4b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Deleting offline snapshot ea3081ba-6214-4b90-bbb6-5de6c05dce4b of volume 32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] snapshot_file for this snap is: volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ae05e6-41e5-4136-8e11-516c6f37acd5]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:01 devstack sudo[101165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b
Nov 05 04:27:01 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:01 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32249ebf-ee57-43c4-8772-8b6951f79c93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf00d05-ee4b-4fb9-be13-696c3a798d35]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:02 devstack sudo[101170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93
Nov 05 04:27:02 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:02 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93" returned: 0 in 0.704s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:02 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b
Nov 05 04:27:02 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:03 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b" returned: 0 in 0.438s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:03 devstack sudo[101188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b
Nov 05 04:27:03 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:03 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93.ea3081ba-6214-4b90-bbb6-5de6c05dce4b" returned: 0 in 0.346s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-ea3081ba-6214-4b90-bbb6-5de6c05dce4b" released by "_delete_snapshot" :: held 2.033s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" released by "delete_snapshot" :: held 2.067s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Created reservations ['b21284ea-043d-4301-8d23-58b002ec5f19', '2aa6d7ab-fc14-4779-9374-4d2e8fe39ff5', '66e7271f-2181-4214-b78b-d727163c3363', '02686d97-cd52-4b76-afac-926a56d7bdfa'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Delete snapshot completed successfully.
Nov 05 04:27:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e84b7d29-b6cb-44e7-aa90-eb6fb1d04f13 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-ea3081ba-6214-4b90-bbb6-5de6c05dce4b-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-32249ebf-ee57-43c4-8772-8b6951f79c93-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-32249ebf-ee57-43c4-8772-8b6951f79c93-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4979e0-c861-4c06-8440-37340f33da94]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:05 devstack sudo[101191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93
Nov 05 04:27:05 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:05 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93" returned: 0 in 0.568s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:05 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93
Nov 05 04:27:05 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:05 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-32249ebf-ee57-43c4-8772-8b6951f79c93" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-quobyte-32249ebf-ee57-43c4-8772-8b6951f79c93" released by "delete_volume" :: held 1.090s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Created reservations ['26f53621-ac10-4a2e-a787-318b93f42731', 'e752e78d-2efc-449d-82e5-81a97f7aa0a1', 'fe4ac7ad-aed1-4dc8-b081-8c73f444f954', '43f3c755-11a3-4a14-9a13-76057db87057'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:06 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:06 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:06 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.367s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Deleted volume successfully.
Nov 05 04:27:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0cc6a7e8-94e4-4f12-9bf8-7de9174ca573 tempest-VolumesSnapshotListTestJSON-864756413 None] Lock "cinder-32249ebf-ee57-43c4-8772-8b6951f79c93-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:07 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=166,cinder:UPDATE=132,cinder:DELETE=11,cinder:INSERT=44 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:27:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-17dfe34c-d69f-4d27-8e26-bd71b427036e req-79053058-5d44-4a0e-84a8-8af5f98d9b0d tempest-TestInstancesWithCinderVolumes-966562766 None] Terminate volume connection completed successfully.
Nov 05 04:27:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-17dfe34c-d69f-4d27-8e26-bd71b427036e req-79053058-5d44-4a0e-84a8-8af5f98d9b0d tempest-TestInstancesWithCinderVolumes-966562766 None] Deleting attachment ebfa598d-f5b5-4ee7-b891-65dec3747deb. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:27:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "cinder-58a9b47d-e2e7-4a56-bbe5-38897f827509-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-58a9b47d-e2e7-4a56-bbe5-38897f827509-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:08 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=168,cinder:INSERT=51,cinder:SELECT=144,cinder:DELETE=13 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:27:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "cinder-quobyte-58a9b47d-e2e7-4a56-bbe5-38897f827509" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-quobyte-58a9b47d-e2e7-4a56-bbe5-38897f827509" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fd39ab-3aed-480b-a5e7-3243fbe7fb24]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:08 devstack sudo[101234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509
Nov 05 04:27:08 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:08 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509" returned: 0 in 0.771s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:08 devstack sudo[101239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509
Nov 05 04:27:08 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:09 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-58a9b47d-e2e7-4a56-bbe5-38897f827509" returned: 0 in 0.340s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-quobyte-58a9b47d-e2e7-4a56-bbe5-38897f827509" released by "delete_volume" :: held 1.183s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:09 devstack cinder-volume[87166]: WARNING cinder.quota [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1849061507-507623265 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1849061507-507623265, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:09 devstack cinder-volume[87166]: WARNING cinder.quota [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1849061507-507623265 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1849061507-507623265, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Created reservations ['e21dfaa0-0e04-47cd-b86c-1ca482a07181', 'f48bc6a0-f965-4dc6-aaad-139e17673e23', '8e4086d5-cb18-40f0-83de-ffe7d524a269', 'a64424dd-5ce8-4f8f-872c-c3d388eb9648'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:09 devstack sudo[101243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:09 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:09 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.424s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Deleted volume successfully.
Nov 05 04:27:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-741463b7-75f5-4ed1-8a1b-54bfb7e4048b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-58a9b47d-e2e7-4a56-bbe5-38897f827509-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Flow 'volume_create_manager' (7f13c470-577d-4733-8355-eb8d6ce601ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7a2460-fe38-4891-8185-24ad8d726458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f7a2460-fe38-4891-8185-24ad8d726458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1013012638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a493f28c-4933-480a-9a1b-5a7d12d168d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40690ecfe7a54900934aac714ed38738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:12Z,use_quota=True,user_id='3aab3f48064144d2b358d016c796c7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b78b6c7-6c75-4c93-97c8-248a65b3fd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b78b6c7-6c75-4c93-97c8-248a65b3fd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02db1159-6dbb-4d66-998e-29ded40745a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02db1159-6dbb-4d66-998e-29ded40745a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a493f28c-4933-480a-9a1b-5a7d12d168d7', 'volume_name': 'volume-a493f28c-4933-480a-9a1b-5a7d12d168d7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9df016b-00b8-442c-b673-67daa758138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9df016b-00b8-442c-b673-67daa758138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2763898c-ef75-4a8f-a0a2-33ee2c466a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Volume a493f28c-4933-480a-9a1b-5a7d12d168d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a493f28c-4933-480a-9a1b-5a7d12d168d7', 'volume_size': 1}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1013012638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a493f28c-4933-480a-9a1b-5a7d12d168d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40690ecfe7a54900934aac714ed38738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:12Z,use_quota=True,user_id='3aab3f48064144d2b358d016c796c7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Creating volume a493f28c-4933-480a-9a1b-5a7d12d168d7 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:27:12 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:12 devstack sudo[101268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7 1073741824
Nov 05 04:27:12 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-5db35cb2-445d-49e6-b472-ca2e14b0fec2 req-9134d635-8dc8-4b22-9a28-2b50625b0f34 tempest-TestInstancesWithCinderVolumes-966562766 None] Terminate volume connection completed successfully.
Nov 05 04:27:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-5db35cb2-445d-49e6-b472-ca2e14b0fec2 req-9134d635-8dc8-4b22-9a28-2b50625b0f34 tempest-TestInstancesWithCinderVolumes-966562766 None] Deleting attachment cbdc7660-4e8e-455b-adeb-6166ec1bf1e5. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:27:13 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7 1073741824" returned: 0 in 0.621s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:13 devstack sudo[101276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7
Nov 05 04:27:13 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:13 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2763898c-ef75-4a8f-a0a2-33ee2c466a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a493f28c-4933-480a-9a1b-5a7d12d168d7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82546b00-b459-4f13-8ce2-ca625f1f01a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Volume volume-a493f28c-4933-480a-9a1b-5a7d12d168d7 (a493f28c-4933-480a-9a1b-5a7d12d168d7): created successfully
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82546b00-b459-4f13-8ce2-ca625f1f01a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Flow 'volume_create_manager' (7f13c470-577d-4733-8355-eb8d6ce601ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "cinder-72a3494c-40be-4506-b174-b8d1fefdce48-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fbb49072-48b7-4873-8652-00627c89c8c6 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Created volume successfully.
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-72a3494c-40be-4506-b174-b8d1fefdce48-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "cinder-quobyte-72a3494c-40be-4506-b174-b8d1fefdce48" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-quobyte-72a3494c-40be-4506-b174-b8d1fefdce48" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca911e4-354c-4756-aad6-aa49f9f575c6]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:14 devstack sudo[101281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48
Nov 05 04:27:14 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Flow 'volume_create_manager' (a2c53286-c4c0-4089-bcc9-dc3f5d3fa98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3349b2-4aca-416d-846d-5023cf39d9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3349b2-4aca-416d-846d-5023cf39d9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1193803000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bd76a9-3404-4aa8-ad45-5d6e3979d7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be47ec051f9d4ee386e0ef418ab6a73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:14Z,use_quota=True,user_id='97d31eab134b4b3fab595f94df988970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6073ca05-27bc-4d7b-886d-b2a914866f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6073ca05-27bc-4d7b-886d-b2a914866f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b0fdfe-eaca-4d71-9d4c-2f3fd03a4fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b0fdfe-eaca-4d71-9d4c-2f3fd03a4fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3bd76a9-3404-4aa8-ad45-5d6e3979d7da', 'volume_name': 'volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da', 'volume_size': 2}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae165b6f-b931-4beb-9c69-f64e58ac854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae165b6f-b931-4beb-9c69-f64e58ac854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dbda61-9ab1-476a-845a-29d881843b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Volume d3bd76a9-3404-4aa8-ad45-5d6e3979d7da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da', 'volume_size': 2}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1193803000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bd76a9-3404-4aa8-ad45-5d6e3979d7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be47ec051f9d4ee386e0ef418ab6a73f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:14Z,use_quota=True,user_id='97d31eab134b4b3fab595f94df988970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Creating volume d3bd76a9-3404-4aa8-ad45-5d6e3979d7da {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:27:14 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da 2147483648 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:14 devstack sudo[101283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da 2147483648
Nov 05 04:27:14 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:14 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48" returned: 0 in 0.512s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:14 devstack sudo[101288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48
Nov 05 04:27:14 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Acquiring lock "cinder-a493f28c-4933-480a-9a1b-5a7d12d168d7-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:14 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "cinder-a493f28c-4933-480a-9a1b-5a7d12d168d7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-72a3494c-40be-4506-b174-b8d1fefdce48" returned: 0 in 0.378s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-quobyte-72a3494c-40be-4506-b174-b8d1fefdce48" released by "delete_volume" :: held 0.952s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Acquiring lock "cinder-quobyte-a493f28c-4933-480a-9a1b-5a7d12d168d7" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:14 devstack cinder-volume[87166]: WARNING cinder.quota [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1234032659-1413184648 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1234032659-1413184648, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:14 devstack cinder-volume[87166]: WARNING cinder.quota [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1234032659-1413184648 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1234032659-1413184648, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "cinder-quobyte-a493f28c-4933-480a-9a1b-5a7d12d168d7" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:14 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da 2147483648" returned: 0 in 0.721s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[887d42f5-c482-4e6d-87bc-dddf7d114ef0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Created reservations ['af157184-e494-4399-8e65-969ff42f8937', 'f218bab8-ee64-4b28-8c16-90cb6b9247b0', '2b65f8c4-869b-425e-b899-d1d67f228535', '5d16ab26-7f44-46f2-a09e-154e9884aebe'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:15 devstack sudo[101296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da
Nov 05 04:27:15 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:15 devstack sudo[101295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7
Nov 05 04:27:15 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:15 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:15 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:15 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7" returned: 0 in 0.466s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:15 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" returned: 0 in 0.444s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:15 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:15 devstack sudo[101308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7
Nov 05 04:27:15 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dbda61-9ab1-476a-845a-29d881843b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da', 'volume_size': 2}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0421cf-0412-423b-bc0f-57680a47fccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Deleted volume successfully.
Nov 05 04:27:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Volume volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da (d3bd76a9-3404-4aa8-ad45-5d6e3979d7da): created successfully
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0421cf-0412-423b-bc0f-57680a47fccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Flow 'volume_create_manager' (a2c53286-c4c0-4089-bcc9-dc3f5d3fa98f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5c8a1943-2a06-4938-876c-78ecaadf41b4 tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-72a3494c-40be-4506-b174-b8d1fefdce48-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ddff5e6d-6733-4d15-a1bb-c68820c06dd3 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Created volume successfully.
Nov 05 04:27:15 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a493f28c-4933-480a-9a1b-5a7d12d168d7" returned: 0 in 0.341s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "cinder-quobyte-a493f28c-4933-480a-9a1b-5a7d12d168d7" released by "delete_volume" :: held 0.890s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Created reservations ['3973675f-ce90-44ed-bde8-65b587d475c4', '9ef19f43-7f13-44d0-be19-46383f15a9e2', '667a3e1b-8892-4541-90f1-9170d7fd0734', '5d66fef2-b309-48fb-b352-19def08eb1e6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:15 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:15 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:16 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Deleted volume successfully.
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d871bcb0-3d52-4d98-afed-ecdec9c5ed60 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "cinder-a493f28c-4933-480a-9a1b-5a7d12d168d7-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Creating offline snapshot 9f5df62a-6bfd-418b-bd6f-69426d385e4a of volume d3bd76a9-3404-4aa8-ad45-5d6e3979d7da {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d62e397-9d35-4a57-8640-eef2fc4fe210]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:16 devstack sudo[101314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da
Nov 05 04:27:16 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Flow 'volume_create_manager' (9346d40e-cb24-40e5-b111-d76cf4856973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ab2d86-bdcc-44cf-86d4-7a3595a22c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ab2d86-bdcc-44cf-86d4-7a3595a22c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2019326768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7176d9-c18d-4435-953c-261146e224a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40690ecfe7a54900934aac714ed38738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:17Z,use_quota=True,user_id='3aab3f48064144d2b358d016c796c7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6c7529-d773-4040-8947-8322a69c3baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6c7529-d773-4040-8947-8322a69c3baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3d137a-112c-4f5f-a4d5-de44a51af1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3d137a-112c-4f5f-a4d5-de44a51af1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe7176d9-c18d-4435-953c-261146e224a5', 'volume_name': 'volume-fe7176d9-c18d-4435-953c-261146e224a5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4d9acc-a83b-476d-aa8f-2cc9aaf7e7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4d9acc-a83b-476d-aa8f-2cc9aaf7e7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8510face-3924-4627-831c-f225a05fd80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Volume fe7176d9-c18d-4435-953c-261146e224a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe7176d9-c18d-4435-953c-261146e224a5', 'volume_size': 1}
Nov 05 04:27:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:17 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" returned: 0 in 0.562s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a 2G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:17 devstack sudo[101320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a 2G
Nov 05 04:27:17 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:17 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a 2G" returned: 0 in 0.666s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:17 devstack sudo[101337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a
Nov 05 04:27:17 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:18 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a" returned: 0 in 0.515s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:18 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a is being set with open permissions: ugo+rw
Nov 05 04:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:18 devstack sudo[101361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a
Nov 05 04:27:18 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:18 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a" returned: 0 in 0.348s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:18 devstack sudo[101365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.info
Nov 05 04:27:18 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:18 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.info" returned: 0 in 0.292s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:18 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.info is being set with open permissions: ugo+rw
Nov 05 04:27:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:18 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.info
Nov 05 04:27:18 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:19 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.info" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.779s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.225s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2019326768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7176d9-c18d-4435-953c-261146e224a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40690ecfe7a54900934aac714ed38738',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:17Z,use_quota=True,user_id='3aab3f48064144d2b358d016c796c7a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Creating volume fe7176d9-c18d-4435-953c-261146e224a5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:27:19 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:19 devstack sudo[101372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5 1073741824
Nov 05 04:27:19 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-93f1ba91-3401-439e-b61d-0b865d923aa5 tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Create snapshot completed successfully
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Acquiring lock "cinder-9f5df62a-6bfd-418b-bd6f-69426d385e4a-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-9f5df62a-6bfd-418b-bd6f-69426d385e4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Acquiring lock "cinder-quobyte-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-quobyte-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Acquiring lock "cinder-quobyte-9f5df62a-6bfd-418b-bd6f-69426d385e4a" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-quobyte-9f5df62a-6bfd-418b-bd6f-69426d385e4a" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Deleting offline snapshot 9f5df62a-6bfd-418b-bd6f-69426d385e4a of volume d3bd76a9-3404-4aa8-ad45-5d6e3979d7da {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] snapshot_file for this snap is: volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c5a708-e5b1-4404-a05a-0ba3d0256082]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:19 devstack sudo[101380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a
Nov 05 04:27:19 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:19 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5 1073741824" returned: 0 in 0.803s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-7ff3dbf9-f0b7-41be-a084-06ca423a7d75 req-36db2b9e-74a0-4866-905d-45856d99d217 tempest-TestInstancesWithCinderVolumes-966562766 None] Terminate volume connection completed successfully.
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-7ff3dbf9-f0b7-41be-a084-06ca423a7d75 req-36db2b9e-74a0-4866-905d-45856d99d217 tempest-TestInstancesWithCinderVolumes-966562766 None] Deleting attachment b3835962-6ce3-4463-b5e5-82c127adbb82. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:20 devstack sudo[101382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5
Nov 05 04:27:20 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:20 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a" returned: 0 in 0.553s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[666af829-4054-47ff-9e57-65bd75b06f60]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:20 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8510face-3924-4627-831c-f225a05fd80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe7176d9-c18d-4435-953c-261146e224a5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6d14a1-d813-4376-952e-05fdff82c20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:20 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Volume volume-fe7176d9-c18d-4435-953c-261146e224a5 (fe7176d9-c18d-4435-953c-261146e224a5): created successfully
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6d14a1-d813-4376-952e-05fdff82c20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Flow 'volume_create_manager' (9346d40e-cb24-40e5-b111-d76cf4856973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-86901dff-ae2d-4aa4-8204-9bd1d8fd64a0 tempest-VolumeQuotasAdminTestJSON-1904447127 None] Created volume successfully.
Nov 05 04:27:20 devstack sudo[101388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da
Nov 05 04:27:20 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:20 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" returned: 0 in 0.440s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:20 devstack sudo[101394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a
Nov 05 04:27:20 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "cinder-49d93493-9ddf-45a9-839b-7bb0b768430e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-49d93493-9ddf-45a9-839b-7bb0b768430e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "cinder-quobyte-49d93493-9ddf-45a9-839b-7bb0b768430e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-quobyte-49d93493-9ddf-45a9-839b-7bb0b768430e" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:21 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79d08fd-08b9-4e4f-8700-c1affb1ca82c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:21 devstack sudo[101399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a
Nov 05 04:27:21 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:21 devstack sudo[101400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e
Nov 05 04:27:21 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:21 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da.9f5df62a-6bfd-418b-bd6f-69426d385e4a" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-quobyte-9f5df62a-6bfd-418b-bd6f-69426d385e4a" released by "_delete_snapshot" :: held 2.017s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-quobyte-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" released by "delete_snapshot" :: held 2.064s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:21 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e" returned: 0 in 0.486s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:21 devstack sudo[101408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e
Nov 05 04:27:21 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:21 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Created reservations ['c2f16f6d-f065-406b-a30a-799b1a071d13', '083968b4-8f56-49bd-becd-40317b242da9', '66009a88-58a8-478d-a07c-210646f6c24d', 'b59ff4e9-14cc-4004-98ef-2c907b61482c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Delete snapshot completed successfully.
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c9ca04f8-7e3a-41ef-9937-c441f59dccec tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-9f5df62a-6bfd-418b-bd6f-69426d385e4a-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9dcfc174-32a7-493b-b1f7-d9b21865058d tempest-VolumeQuotasAdminTestJSON-165739748 None] Transfer volume completed successfully.
Nov 05 04:27:22 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-49d93493-9ddf-45a9-839b-7bb0b768430e" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-quobyte-49d93493-9ddf-45a9-839b-7bb0b768430e" released by "delete_volume" :: held 0.877s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:22 devstack cinder-volume[87166]: WARNING cinder.quota [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898547595-1303072503 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898547595-1303072503, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:22 devstack cinder-volume[87166]: WARNING cinder.quota [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898547595-1303072503 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898547595-1303072503, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Created reservations ['275f9f19-e8fe-4a71-88a9-469f324a71fa', 'b9e69953-7832-49a1-b846-28d6054c1f72', 'c2c79365-d474-43b9-8d39-68649c53f861', 'c2e8e2b4-2e29-4273-9be3-73ff5a4e966d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:22 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:22 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Acquiring lock "cinder-fe7176d9-c18d-4435-953c-261146e224a5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:22 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Lock "cinder-fe7176d9-c18d-4435-953c-261146e224a5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Deleted volume successfully.
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Acquiring lock "cinder-quobyte-fe7176d9-c18d-4435-953c-261146e224a5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7ecefa40-607f-49eb-a0c9-1ca5b3493d0b tempest-TestInstancesWithCinderVolumes-966562766 None] Lock "cinder-49d93493-9ddf-45a9-839b-7bb0b768430e-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Lock "cinder-quobyte-fe7176d9-c18d-4435-953c-261146e224a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7539612-683f-4c93-8df0-585d000e701a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:23 devstack sudo[101415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5
Nov 05 04:27:23 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Acquiring lock "cinder-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Acquiring lock "cinder-quobyte-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-quobyte-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb4655a-2ff0-4e6f-9584-ac487235c549]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:23 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5" returned: 0 in 0.543s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:23 devstack sudo[101417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da
Nov 05 04:27:23 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:23 devstack sudo[101423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5
Nov 05 04:27:23 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:23 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" returned: 0 in 0.608s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:23 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fe7176d9-c18d-4435-953c-261146e224a5" returned: 0 in 0.469s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:23 devstack sudo[101431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da
Nov 05 04:27:23 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Lock "cinder-quobyte-fe7176d9-c18d-4435-953c-261146e224a5" released by "delete_volume" :: held 1.105s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Created reservations ['8317bdd0-4473-4048-b4f7-6395f999c8fa', '888dda10-5a4f-4c0a-b970-01fe75b21b8d', 'b7d2b4f8-9263-4156-bb0b-53306a4632e2', '88c5732b-5a24-40d7-b6a0-23a8dec64e34'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:24 devstack sudo[101433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:24 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:24 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" returned: 0 in 0.351s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-quobyte-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da" released by "delete_volume" :: held 1.062s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Created reservations ['66b40f30-0234-40a8-98a1-c78b92f6186c', '47b94eff-a7fb-4352-8ff5-1071e3bc21c5', 'a2a32480-f1aa-43bd-8f5b-eea33b53fc7c', '60ee3c56-8345-4bee-8fe6-379cf48a2be1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:24 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Deleted volume successfully.
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-21b011d2-5298-4ef5-9e5c-8a0d581e4345 tempest-VolumeQuotasAdminTestJSON-1998830533 None] Lock "cinder-fe7176d9-c18d-4435-953c-261146e224a5-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:24 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:24 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:24 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Deleted volume successfully.
Nov 05 04:27:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2f920f59-399d-4f28-ad4e-b072ddce18ae tempest-VolumesSnapshotNegativeTestJSON-1294133517 None] Lock "cinder-d3bd76a9-3404-4aa8-ad45-5d6e3979d7da-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:29 devstack sudo[101441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:29 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:29 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.400s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:27:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Flow 'volume_create_manager' (63a52f99-d278-464a-92f1-13e8be550a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2036958d-660b-4dbd-9829-c5aa34fd6860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2036958d-660b-4dbd-9829-c5aa34fd6860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-729506594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995ab850-0488-4ae9-97e3-0ccc76563083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca0297c9a7d4513babd88d1ff6825bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:34Z,use_quota=True,user_id='6315c4a9e8fd4d55848299104d3da950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c5c87d-d910-4085-ad13-b2ffbe773df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5c5c87d-d910-4085-ad13-b2ffbe773df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba90566-6188-48f3-a4ee-48e15c726f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:33 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba90566-6188-48f3-a4ee-48e15c726f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '995ab850-0488-4ae9-97e3-0ccc76563083', 'volume_name': 'volume-995ab850-0488-4ae9-97e3-0ccc76563083', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7eaa540>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa12649a-98b9-4b3b-a34b-92dd647c11de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa12649a-98b9-4b3b-a34b-92dd647c11de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27584883-7e1e-4efc-bab5-cf24018274f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Volume 995ab850-0488-4ae9-97e3-0ccc76563083: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-995ab850-0488-4ae9-97e3-0ccc76563083', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7eaa540>}
Nov 05 04:27:34 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Trying to clone 995ab850-0488-4ae9-97e3-0ccc76563083 from image 6ded3d1d-d482-4fc8-985e-41c27b256803 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:27:34 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:27:34 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 04:27:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ad4b3b-673f-44ff-a371-db167595e73b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:35 devstack sudo[101486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD
Nov 05 04:27:35 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:35 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 is fetched for user 6315c4a9e8fd4d55848299104d3da950. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[61049fe9-0dd7-4a62-83ae-bf7e395b0219]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:35 devstack sudo[101493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD
Nov 05 04:27:35 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:35 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-729506594',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995ab850-0488-4ae9-97e3-0ccc76563083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ca0297c9a7d4513babd88d1ff6825bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:34Z,use_quota=True,user_id='6315c4a9e8fd4d55848299104d3da950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Creating volume 995ab850-0488-4ae9-97e3-0ccc76563083 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:27:35 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:27:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:36 devstack sudo[101498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 1073741824
Nov 05 04:27:36 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Flow 'volume_create_manager' (edea6660-7727-4c3d-9ee7-11775a164273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a72a2db-2572-48b9-af84-41d653a9cc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a72a2db-2572-48b9-af84-41d653a9cc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abdc3ed-5e85-4238-aba2-2cda33029e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc499d656444399a17424001d7b1ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:36Z,use_quota=True,user_id='93deb735c4024b9aacd3af3576f8135c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce78e65c-a443-4e33-a44e-1dee71147a08),volume_type_id=ce78e65c-a443-4e33-a44e-1dee71147a08)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c781a384-24ee-4459-a356-a3bd7fdf9097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c781a384-24ee-4459-a356-a3bd7fdf9097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d5be84-8ab7-4f78-82e4-6e9ce16adedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:27:36 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 1073741824" returned: 0 in 0.596s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:36 devstack sudo[101504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083
Nov 05 04:27:36 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d5be84-8ab7-4f78-82e4-6e9ce16adedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1abdc3ed-5e85-4238-aba2-2cda33029e53', 'volume_name': 'volume-1abdc3ed-5e85-4238-aba2-2cda33029e53', 'volume_size': 1, 'image_id': '00945d67-2917-49f9-ac99-4165f31ba75e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00945d67-2917-49f9-ac99-4165f31ba75e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '59cd604b7524c74b3cca547df681d232', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1dc499d656444399a17424001d7b1ca0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd24ad57c95a87e63e862f1382bcdb277d3d8eb7e9362ee7a299f6ef11e5f8e705361dc6c1ff83ba91e9006d5843cf6ab7aa916ce846a51a10158aab27488ce26', 'id': '00945d67-2917-49f9-ac99-4165f31ba75e', 'created_at': datetime.datetime(2026, 11, 5, 3, 27, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 27, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00945d67-2917-49f9-ac99-4165f31ba75e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f2302c00>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83b9bae-07fd-498c-bca4-2e2cdd5a0d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83b9bae-07fd-498c-bca4-2e2cdd5a0d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86c0d1b-3439-4b4c-b9ee-e7a1fba01a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:36 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Volume 1abdc3ed-5e85-4238-aba2-2cda33029e53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1abdc3ed-5e85-4238-aba2-2cda33029e53', 'volume_size': 1, 'image_id': '00945d67-2917-49f9-ac99-4165f31ba75e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00945d67-2917-49f9-ac99-4165f31ba75e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '59cd604b7524c74b3cca547df681d232', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1dc499d656444399a17424001d7b1ca0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd24ad57c95a87e63e862f1382bcdb277d3d8eb7e9362ee7a299f6ef11e5f8e705361dc6c1ff83ba91e9006d5843cf6ab7aa916ce846a51a10158aab27488ce26', 'id': '00945d67-2917-49f9-ac99-4165f31ba75e', 'created_at': datetime.datetime(2026, 11, 5, 3, 27, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 27, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00945d67-2917-49f9-ac99-4165f31ba75e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f2302c00>}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Trying to clone 1abdc3ed-5e85-4238-aba2-2cda33029e53 from image 00945d67-2917-49f9-ac99-4165f31ba75e at location (None, [{'url': 'file:///opt/stack/data/glance/images/00945d67-2917-49f9-ac99-4165f31ba75e', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:27:36 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:27:36 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:27:37 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083" returned: 0 in 0.424s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d73577-7a01-4e23-b78b-7a8ad11d27c8]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Attempting download of 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume 995ab850-0488-4ae9-97e3-0ccc76563083. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Flow 'volume_create_manager' (94d1005f-38ee-4957-aa4e-b039de737b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152554b9-6bff-4e96-abec-6979bd8cf8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152554b9-6bff-4e96-abec-6979bd8cf8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2045974103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5615d150-8118-4740-aa3b-3b16c43b0df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41dd7a9abead4965bca857eb8a0f5820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:37Z,use_quota=True,user_id='cc9b45ce77ce447d98a0510130e39c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbffa251-52d9-4035-963e-699a6ebbdcfc),volume_type_id=fbffa251-52d9-4035-963e-699a6ebbdcfc)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a9da34-0b31-4290-90f0-200fcdfafd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a9da34-0b31-4290-90f0-200fcdfafd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:37 devstack sudo[101507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD
Nov 05 04:27:37 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d02111-2b84-4789-a3e2-c9e866561899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d02111-2b84-4789-a3e2-c9e866561899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5615d150-8118-4740-aa3b-3b16c43b0df5', 'volume_name': 'volume-5615d150-8118-4740-aa3b-3b16c43b0df5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012a8014-67f8-44c9-bc75-d66671e92cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012a8014-67f8-44c9-bc75-d66671e92cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cbd455-6bc5-4ec0-9a2b-0f1dd955ce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Volume 5615d150-8118-4740-aa3b-3b16c43b0df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5615d150-8118-4740-aa3b-3b16c43b0df5', 'volume_size': 1}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2045974103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5615d150-8118-4740-aa3b-3b16c43b0df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41dd7a9abead4965bca857eb8a0f5820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:37Z,use_quota=True,user_id='cc9b45ce77ce447d98a0510130e39c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbffa251-52d9-4035-963e-699a6ebbdcfc),volume_type_id=fbffa251-52d9-4035-963e-699a6ebbdcfc)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Creating volume 5615d150-8118-4740-aa3b-3b16c43b0df5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:27:37 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c38eaf-611d-4647-ae30-8add32c34d15]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_8e5afurq {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:37 devstack sudo[101509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5 1073741824
Nov 05 04:27:37 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:37 devstack sudo[101510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_8e5afurq
Nov 05 04:27:37 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:37 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:37 devstack sudo[101516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD
Nov 05 04:27:37 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:37 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_8e5afurq" returned: 0 in 0.395s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_8e5afurq {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:37 devstack sudo[101523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_8e5afurq
Nov 05 04:27:37 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:37 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5 1073741824" returned: 0 in 0.590s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:37 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:27:37 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Temporary image 00945d67-2917-49f9-ac99-4165f31ba75e is fetched for user 93deb735c4024b9aacd3af3576f8135c. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:27:37 devstack sudo[101529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5
Nov 05 04:27:37 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[17331b5d-1ed4-46af-9c33-5377e9e86698]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:38 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_8e5afurq" returned: 1 in 0.480s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_8e5afurq' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3f2395-4ec8-4ba5-8814-f4152e8bbed8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:38 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:38 devstack sudo[101531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD
Nov 05 04:27:38 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10cbd455-6bc5-4ec0-9a2b-0f1dd955ce41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5615d150-8118-4740-aa3b-3b16c43b0df5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39af2097-94d9-471d-aa20-29675b777683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Volume volume-5615d150-8118-4740-aa3b-3b16c43b0df5 (5615d150-8118-4740-aa3b-3b16c43b0df5): created successfully
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39af2097-94d9-471d-aa20-29675b777683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Flow 'volume_create_manager' (94d1005f-38ee-4957-aa4e-b039de737b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-570f2e52-185d-4edb-b26e-9c1357f781ee tempest-VolumeTypesAccessTest-401547228 None] Created volume successfully.
Nov 05 04:27:38 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD
Nov 05 04:27:38 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:38 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:38 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] 6ded3d1d-d482-4fc8-985e-41c27b256803 was qcow2, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:38 devstack sudo[101540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD
Nov 05 04:27:38 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:38 devstack sudo[101544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083
Nov 05 04:27:38 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:38 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abdc3ed-5e85-4238-aba2-2cda33029e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dc499d656444399a17424001d7b1ca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:36Z,use_quota=True,user_id='93deb735c4024b9aacd3af3576f8135c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce78e65c-a443-4e33-a44e-1dee71147a08),volume_type_id=ce78e65c-a443-4e33-a44e-1dee71147a08)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Creating volume 1abdc3ed-5e85-4238-aba2-2cda33029e53 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:27:38 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:27:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:38 devstack sudo[101553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 1073741824
Nov 05 04:27:38 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Acquiring lock "cinder-5615d150-8118-4740-aa3b-3b16c43b0df5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Lock "cinder-5615d150-8118-4740-aa3b-3b16c43b0df5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Acquiring lock "cinder-quobyte-5615d150-8118-4740-aa3b-3b16c43b0df5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Lock "cinder-quobyte-5615d150-8118-4740-aa3b-3b16c43b0df5" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:39 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 1073741824" returned: 0 in 0.648s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c471d3-e818-4bda-a85b-af72d87f423e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:39 devstack sudo[101563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53
Nov 05 04:27:39 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:39 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5
Nov 05 04:27:39 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:39 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53" returned: 0 in 0.323s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Attempting download of 00945d67-2917-49f9-ac99-4165f31ba75e ((None, [{'url': 'file:///opt/stack/data/glance/images/00945d67-2917-49f9-ac99-4165f31ba75e', 'metadata': {}}])) to volume 1abdc3ed-5e85-4238-aba2-2cda33029e53. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d46d3e-b3f8-4e82-8491-bcdfbba6e349]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00945d67-2917-49f9-ac99-4165f31ba75e_tnukx86v {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:39 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5" returned: 0 in 0.530s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:40 devstack sudo[101572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5
Nov 05 04:27:40 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:40 devstack sudo[101571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00945d67-2917-49f9-ac99-4165f31ba75e_tnukx86v
Nov 05 04:27:40 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:40 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00945d67-2917-49f9-ac99-4165f31ba75e_tnukx86v" returned: 0 in 0.517s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00945d67-2917-49f9-ac99-4165f31ba75e_tnukx86v {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:40 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5615d150-8118-4740-aa3b-3b16c43b0df5" returned: 0 in 0.487s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Lock "cinder-quobyte-5615d150-8118-4740-aa3b-3b16c43b0df5" released by "delete_volume" :: held 1.101s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:40 devstack cinder-volume[87166]: WARNING cinder.quota [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1451162739 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1451162739, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:40 devstack cinder-volume[87166]: WARNING cinder.quota [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1451162739 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1451162739, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Created reservations ['f6468912-164e-4a4e-875d-5f74c9e58c48', '8cec1e31-4cf6-478c-ad34-b966421131c8', 'a8b23c56-f497-41ce-84b6-d6743ba8a46b', 'b97d33fe-0422-41fe-b656-bc7c93a801a7'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:40 devstack sudo[101578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00945d67-2917-49f9-ac99-4165f31ba75e_tnukx86v
Nov 05 04:27:40 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:40 devstack sudo[101580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:40 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:40 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00945d67-2917-49f9-ac99-4165f31ba75e_tnukx86v" returned: 1 in 0.517s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00945d67-2917-49f9-ac99-4165f31ba75e_tnukx86v' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb1fd6-bc91-4ad6-8d23-eb52703b0120]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:40 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:40 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Deleted volume successfully.
Nov 05 04:27:41 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083" returned: 0 in 2.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_unwzsncgdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:27:41 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Converted 112.00 MB image at 44.82 MB/s
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1ae9aec5-cdd1-4ac9-a02e-feb06a175983 tempest-VolumeTypesAccessTest-401547228 None] Lock "cinder-5615d150-8118-4740-aa3b-3b16c43b0df5-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:41 devstack sudo[101586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 1G
Nov 05 04:27:41 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:41 devstack sudo[101585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD
Nov 05 04:27:41 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:41 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:41 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 1G" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Downloaded image 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume 995ab850-0488-4ae9-97e3-0ccc76563083 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 for user 6315c4a9e8fd4d55848299104d3da950 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Marking volume 995ab850-0488-4ae9-97e3-0ccc76563083 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Copying metadata from image 6ded3d1d-d482-4fc8-985e-41c27b256803 to 995ab850-0488-4ae9-97e3-0ccc76563083. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Creating volume glance metadata for volume 995ab850-0488-4ae9-97e3-0ccc76563083 backed by image 6ded3d1d-d482-4fc8-985e-41c27b256803 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:27:41 devstack sudo[101595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD
Nov 05 04:27:41 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27584883-7e1e-4efc-bab5-cf24018274f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-995ab850-0488-4ae9-97e3-0ccc76563083', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7eaa540>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c094a9-c8f5-4292-8218-727774a26bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Volume volume-995ab850-0488-4ae9-97e3-0ccc76563083 (995ab850-0488-4ae9-97e3-0ccc76563083): created successfully
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c094a9-c8f5-4292-8218-727774a26bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Flow 'volume_create_manager' (63a52f99-d278-464a-92f1-13e8be550a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ac9c4b74-777c-4e9a-9d4a-3dd3b6bd034a tempest-TestShelveInstance-780228114 None] Created volume successfully.
Nov 05 04:27:41 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] 00945d67-2917-49f9-ac99-4165f31ba75e was raw, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:27:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:41 devstack sudo[101600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53
Nov 05 04:27:41 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:42 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53" returned: 0 in 0.506s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00945d67-2917-49f9-ac99-4165f31ba75e_8oz4rq4ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:27:42 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:42 devstack sudo[101606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 1G
Nov 05 04:27:42 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:42 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 1G" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Downloaded image 00945d67-2917-49f9-ac99-4165f31ba75e ((None, [{'url': 'file:///opt/stack/data/glance/images/00945d67-2917-49f9-ac99-4165f31ba75e', 'metadata': {}}])) to volume 1abdc3ed-5e85-4238-aba2-2cda33029e53 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Temporary image 00945d67-2917-49f9-ac99-4165f31ba75e for user 93deb735c4024b9aacd3af3576f8135c is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Marking volume 1abdc3ed-5e85-4238-aba2-2cda33029e53 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Copying metadata from image 00945d67-2917-49f9-ac99-4165f31ba75e to 1abdc3ed-5e85-4238-aba2-2cda33029e53. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Creating volume glance metadata for volume 1abdc3ed-5e85-4238-aba2-2cda33029e53 backed by image 00945d67-2917-49f9-ac99-4165f31ba75e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '00945d67-2917-49f9-ac99-4165f31ba75e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '59cd604b7524c74b3cca547df681d232', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86c0d1b-3439-4b4c-b9ee-e7a1fba01a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abdc3ed-5e85-4238-aba2-2cda33029e53', 'volume_size': 1, 'image_id': '00945d67-2917-49f9-ac99-4165f31ba75e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00945d67-2917-49f9-ac99-4165f31ba75e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '59cd604b7524c74b3cca547df681d232', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1dc499d656444399a17424001d7b1ca0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd24ad57c95a87e63e862f1382bcdb277d3d8eb7e9362ee7a299f6ef11e5f8e705361dc6c1ff83ba91e9006d5843cf6ab7aa916ce846a51a10158aab27488ce26', 'id': '00945d67-2917-49f9-ac99-4165f31ba75e', 'created_at': datetime.datetime(2026, 11, 5, 3, 27, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 27, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00945d67-2917-49f9-ac99-4165f31ba75e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f2302c00>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4a1692-322d-46bd-94c2-5ae16adf0038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Volume volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 (1abdc3ed-5e85-4238-aba2-2cda33029e53): created successfully
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4a1692-322d-46bd-94c2-5ae16adf0038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Flow 'volume_create_manager' (edea6660-7727-4c3d-9ee7-11775a164273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fb21fad8-4c2f-4281-9b56-f93a552d652f tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Created volume successfully.
Nov 05 04:27:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Acquiring lock "cinder-1abdc3ed-5e85-4238-aba2-2cda33029e53-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "cinder-1abdc3ed-5e85-4238-aba2-2cda33029e53-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Acquiring lock "cinder-quobyte-1abdc3ed-5e85-4238-aba2-2cda33029e53" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:27:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "cinder-quobyte-1abdc3ed-5e85-4238-aba2-2cda33029e53" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:27:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38663ef-a283-4601-a3b8-59e05e64362c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:43 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53
Nov 05 04:27:43 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:44 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53" returned: 0 in 0.537s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:44 devstack sudo[101617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53
Nov 05 04:27:44 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:44 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1abdc3ed-5e85-4238-aba2-2cda33029e53" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "cinder-quobyte-1abdc3ed-5e85-4238-aba2-2cda33029e53" released by "delete_volume" :: held 0.960s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:44 devstack cinder-volume[87166]: WARNING cinder.quota [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:44 devstack cinder-volume[87166]: WARNING cinder.quota [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Created reservations ['36e5cd2f-0bdd-4711-a5c8-b60a8287ec2e', 'bc096cf1-a5c8-4113-aee9-7becda96da23', '13abdf2e-7dc0-4e0e-ab40-2e09defd7d7a', '48d40dea-6f8c-4a32-88ba-d66739102ccf'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:45 devstack sudo[101620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:27:45 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:45 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.271s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:45 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:27:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Deleted volume successfully.
Nov 05 04:27:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a32f404e-aea5-4f68-92a2-2a806822b0ea tempest-VolumeAndVolumeTypeFromImageTest-1185944313 None] Lock "cinder-1abdc3ed-5e85-4238-aba2-2cda33029e53-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:27:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-4c9693de-4979-4504-b74f-d36c604d25c7 req-d032b620-3391-415f-b982-2914fb04e101 tempest-TestShelveInstance-780228114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-4c9693de-4979-4504-b74f-d36c604d25c7 req-d032b620-3391-415f-b982-2914fb04e101 tempest-TestShelveInstance-780228114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-4c9693de-4979-4504-b74f-d36c604d25c7 req-d032b620-3391-415f-b982-2914fb04e101 tempest-TestShelveInstance-780228114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-4c9693de-4979-4504-b74f-d36c604d25c7 req-d032b620-3391-415f-b982-2914fb04e101 tempest-TestShelveInstance-780228114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-995ab850-0488-4ae9-97e3-0ccc76563083', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ad2fd383-87ab-4169-92db-bd75c6ce8a81', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:27:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-4c9693de-4979-4504-b74f-d36c604d25c7 req-d032b620-3391-415f-b982-2914fb04e101 tempest-TestShelveInstance-780228114 None] attachment_update completed successfully.
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (862c78b1-d45e-40eb-aade-11703c342264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a86fef5-48ed-4925-ae39-d499418ae0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a86fef5-48ed-4925-ae39-d499418ae0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-335891934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d2c58c-3bce-446c-9899-11a22b1c466b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:56Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401cbc20-c2e3-4fc7-855a-aec1239638fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (401cbc20-c2e3-4fc7-855a-aec1239638fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c1ec91-c941-4313-be16-964097bc23b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0c1ec91-c941-4313-be16-964097bc23b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d2c58c-3bce-446c-9899-11a22b1c466b', 'volume_name': 'volume-33d2c58c-3bce-446c-9899-11a22b1c466b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f10367c-d14f-4eef-becb-d8229dc6f720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f10367c-d14f-4eef-becb-d8229dc6f720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed4b3e5-1953-4910-8fe8-e55d34168675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:56 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume 33d2c58c-3bce-446c-9899-11a22b1c466b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d2c58c-3bce-446c-9899-11a22b1c466b', 'volume_size': 1}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-335891934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d2c58c-3bce-446c-9899-11a22b1c466b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:27:56Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Creating volume 33d2c58c-3bce-446c-9899-11a22b1c466b {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:27:56 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:27:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:56 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b 1073741824
Nov 05 04:27:56 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:57 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b 1073741824" returned: 0 in 0.931s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:57 devstack sudo[102122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b
Nov 05 04:27:57 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:57 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b" returned: 0 in 0.454s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:27:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed4b3e5-1953-4910-8fe8-e55d34168675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d2c58c-3bce-446c-9899-11a22b1c466b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b930ba-bd54-4720-9cdc-2728e3a37821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:27:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume volume-33d2c58c-3bce-446c-9899-11a22b1c466b (33d2c58c-3bce-446c-9899-11a22b1c466b): created successfully
Nov 05 04:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b930ba-bd54-4720-9cdc-2728e3a37821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:27:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (862c78b1-d45e-40eb-aade-11703c342264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:27:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a2447ad0-78ad-486a-b3cf-3c13972bb5ed tempest-CreateVolumesFromSnapshotTest-916638669 None] Created volume successfully.
Nov 05 04:27:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:27:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:27:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Creating offline snapshot 72e0dc1d-0f06-4e4a-9660-6bcc133e291c of volume 33d2c58c-3bce-446c-9899-11a22b1c466b {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:27:58 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e792b1-d8f1-46bf-b91d-15b2f8f56dcd]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:27:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:58 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b
Nov 05 04:27:58 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:59 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b" returned: 0 in 0.549s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:59 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c 1G
Nov 05 04:27:59 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:27:59 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Nov 05 04:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c 1G" returned: 0 in 0.536s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:27:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33d2c58c-3bce-446c-9899-11a22b1c466b -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:27:59 devstack sudo[102137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33d2c58c-3bce-446c-9899-11a22b1c466b -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c
Nov 05 04:27:59 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:00 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33d2c58c-3bce-446c-9899-11a22b1c466b -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c" returned: 0 in 0.375s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:00 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c is being set with open permissions: ugo+rw
Nov 05 04:28:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:00 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c
Nov 05 04:28:00 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:00 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c" returned: 0 in 0.400s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:00 devstack sudo[102145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.info
Nov 05 04:28:00 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:01 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.info" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:01 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.info is being set with open permissions: ugo+rw
Nov 05 04:28:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:01 devstack sudo[102148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.info
Nov 05 04:28:01 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:01 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.info" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2a06e9e8-485d-44c4-a2c7-58d503f56350 tempest-CreateVolumesFromSnapshotTest-916638669 None] Create snapshot completed successfully
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (7bfff44d-5281-49ce-b47d-b217db1f240d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e1130f-0559-4c71-a016-cf953c368775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e1130f-0559-4c71-a016-cf953c368775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726617756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713ee5aa-786a-4143-a7ec-10ed3b15f927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:03Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464964b4-8b2b-4279-9795-9c71172bf9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464964b4-8b2b-4279-9795-9c71172bf9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86300869-f0de-4e7c-985b-6026a7f9b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86300869-f0de-4e7c-985b-6026a7f9b941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713ee5aa-786a-4143-a7ec-10ed3b15f927', 'volume_name': 'volume-713ee5aa-786a-4143-a7ec-10ed3b15f927', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165d831b-e5fb-4f89-aac2-4893c4620aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (165d831b-e5fb-4f89-aac2-4893c4620aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e5e94d-d22c-4c2d-a701-daad6aed3079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume 713ee5aa-786a-4143-a7ec-10ed3b15f927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713ee5aa-786a-4143-a7ec-10ed3b15f927', 'volume_size': 1}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1726617756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713ee5aa-786a-4143-a7ec-10ed3b15f927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:03Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Creating volume 713ee5aa-786a-4143-a7ec-10ed3b15f927 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:28:02 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:28:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:02 devstack sudo[102151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927 1073741824
Nov 05 04:28:02 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:03 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927 1073741824" returned: 0 in 0.635s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:28:03 devstack sudo[102157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927
Nov 05 04:28:03 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (6cc2d0d8-8c40-4445-b75b-65272831cad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9a0dd1-35a0-4b5c-bfd7-799279551155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9a0dd1-35a0-4b5c-bfd7-799279551155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955869643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfede743-f642-4898-8c06-24e78f6fdc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:03Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c317c0cc-3960-406d-bbef-a0b930ce1172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c317c0cc-3960-406d-bbef-a0b930ce1172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3266b03d-5628-46ab-b3e8-de848682b487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3266b03d-5628-46ab-b3e8-de848682b487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfede743-f642-4898-8c06-24e78f6fdc5f', 'volume_name': 'volume-dfede743-f642-4898-8c06-24e78f6fdc5f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a241c745-9fe9-4812-bc4f-c7d4bb5866ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a241c745-9fe9-4812-bc4f-c7d4bb5866ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ac295b-2fd8-4bd8-8105-e293b4d9cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume dfede743-f642-4898-8c06-24e78f6fdc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfede743-f642-4898-8c06-24e78f6fdc5f', 'volume_size': 1}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:03 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927" returned: 0 in 0.494s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955869643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfede743-f642-4898-8c06-24e78f6fdc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:03Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Creating volume dfede743-f642-4898-8c06-24e78f6fdc5f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:28:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e5e94d-d22c-4c2d-a701-daad6aed3079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713ee5aa-786a-4143-a7ec-10ed3b15f927', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:03 devstack sudo[102160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f 1073741824
Nov 05 04:28:03 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915af710-078c-4c8a-87e8-cf737cbd57ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume volume-713ee5aa-786a-4143-a7ec-10ed3b15f927 (713ee5aa-786a-4143-a7ec-10ed3b15f927): created successfully
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915af710-078c-4c8a-87e8-cf737cbd57ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (7bfff44d-5281-49ce-b47d-b217db1f240d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-745d0172-551d-4b23-8468-0c5813f82f6f tempest-CreateVolumesFromSnapshotTest-916638669 None] Created volume successfully.
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (6328545c-6129-4b01-a592-1f13679f37eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff2db38-493c-4774-8b27-bd993d247210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff2db38-493c-4774-8b27-bd993d247210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-968033634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7880d3-14a9-4b23-9b1d-da8c299d76a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:04Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7185bc03-c0ab-410d-b022-d0ec97ae4c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7185bc03-c0ab-410d-b022-d0ec97ae4c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20912d32-9184-4648-be64-9e190a9185c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20912d32-9184-4648-be64-9e190a9185c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7880d3-14a9-4b23-9b1d-da8c299d76a9', 'volume_name': 'volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc09fa0-889c-4af4-a104-d3030436c53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc09fa0-889c-4af4-a104-d3030436c53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ad34a6-6a44-4907-9b7a-35a97248a0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume ed7880d3-14a9-4b23-9b1d-da8c299d76a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9', 'volume_size': 1}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:04 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f 1073741824" returned: 0 in 0.853s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:04 devstack sudo[102166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f
Nov 05 04:28:04 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:28:05 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (d1b63b29-2bb0-4984-9c04-e7daa74698cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e91d408-a79a-4ec4-a9ad-b32f51266395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f" returned: 0 in 0.566s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.045s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-968033634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7880d3-14a9-4b23-9b1d-da8c299d76a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:04Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Creating volume ed7880d3-14a9-4b23-9b1d-da8c299d76a9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:28:05 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e91d408-a79a-4ec4-a9ad-b32f51266395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566229453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de76e5ae-e791-4992-9ed4-52ecb038a007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:05Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de1ed54-4a57-49b4-ad2d-3160970d621f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de1ed54-4a57-49b4-ad2d-3160970d621f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19290a9e-0504-43de-911d-95982b9fd16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19290a9e-0504-43de-911d-95982b9fd16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de76e5ae-e791-4992-9ed4-52ecb038a007', 'volume_name': 'volume-de76e5ae-e791-4992-9ed4-52ecb038a007', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0986a58d-6f8a-46fc-bc6e-75346e4ed1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:05 devstack sudo[102169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9 1073741824
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0986a58d-6f8a-46fc-bc6e-75346e4ed1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:05 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4d3b3b-c9d5-426d-b793-40c58fc2e21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume de76e5ae-e791-4992-9ed4-52ecb038a007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de76e5ae-e791-4992-9ed4-52ecb038a007', 'volume_size': 1}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76ac295b-2fd8-4bd8-8105-e293b4d9cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfede743-f642-4898-8c06-24e78f6fdc5f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940fa4c0-1700-4b7c-9ebe-a772fe7ca51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:05 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume volume-dfede743-f642-4898-8c06-24e78f6fdc5f (dfede743-f642-4898-8c06-24e78f6fdc5f): created successfully
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940fa4c0-1700-4b7c-9ebe-a772fe7ca51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (6cc2d0d8-8c40-4445-b75b-65272831cad2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-31abb824-42c2-4765-a901-b8265bd10ad5 tempest-CreateVolumesFromSnapshotTest-916638669 None] Created volume successfully.
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (4361d4bd-bf55-45ea-ae3b-fabfd0567941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e5247d-8f90-47e1-9da0-b4285cfb7ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e5247d-8f90-47e1-9da0-b4285cfb7ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-617008394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c0c7e2-722a-4fde-9950-5839fbbcc516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:06Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:06 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e7f369-5b74-44a9-aeaa-adaaf563ac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e7f369-5b74-44a9-aeaa-adaaf563ac81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7e8d95-6e07-44b3-8018-f2ceab3d0fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb7e8d95-6e07-44b3-8018-f2ceab3d0fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93c0c7e2-722a-4fde-9950-5839fbbcc516', 'volume_name': 'volume-93c0c7e2-722a-4fde-9950-5839fbbcc516', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2883ab-68fa-4313-8cec-e79fa71e4fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2883ab-68fa-4313-8cec-e79fa71e4fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb37827-8286-43ed-8a8c-c12f7ccd3154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume 93c0c7e2-722a-4fde-9950-5839fbbcc516: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93c0c7e2-722a-4fde-9950-5839fbbcc516', 'volume_size': 1}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9 1073741824" returned: 0 in 0.864s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:06 devstack sudo[102175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9
Nov 05 04:28:06 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:06 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9" returned: 0 in 0.489s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.358s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1566229453',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de76e5ae-e791-4992-9ed4-52ecb038a007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:05Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Creating volume de76e5ae-e791-4992-9ed4-52ecb038a007 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:28:06 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ad34a6-6a44-4907-9b7a-35a97248a0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730da967-fdc7-47db-ad25-3807d0ffbc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:06 devstack sudo[102178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007 1073741824
Nov 05 04:28:06 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:07 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9 (ed7880d3-14a9-4b23-9b1d-da8c299d76a9): created successfully
Nov 05 04:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (730da967-fdc7-47db-ad25-3807d0ffbc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (6328545c-6129-4b01-a592-1f13679f37eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bdcaab2e-4872-434f-bc3b-fa19bf1badfc tempest-CreateVolumesFromSnapshotTest-916638669 None] Created volume successfully.
Nov 05 04:28:07 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007 1073741824" returned: 0 in 0.814s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:07 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=115,cinder:SELECT=97,cinder:INSERT=33,cinder:DELETE=13 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:28:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:07 devstack sudo[102184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007
Nov 05 04:28:07 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:08 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007" returned: 0 in 0.461s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.939s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-617008394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93c0c7e2-722a-4fde-9950-5839fbbcc516,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f12a8df74ac590c663f722b7c990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:06Z,use_quota=True,user_id='8edf47e1ddc7425489c0cfe56196a65a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Creating volume 93c0c7e2-722a-4fde-9950-5839fbbcc516 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:28:08 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=98,cinder:INSERT=39,cinder:UPDATE=104,cinder:DELETE=7 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4d3b3b-c9d5-426d-b793-40c58fc2e21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de76e5ae-e791-4992-9ed4-52ecb038a007', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b268c57-01d3-4614-9289-146503e7692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:08 devstack sudo[102187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516 1073741824
Nov 05 04:28:08 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume volume-de76e5ae-e791-4992-9ed4-52ecb038a007 (de76e5ae-e791-4992-9ed4-52ecb038a007): created successfully
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b268c57-01d3-4614-9289-146503e7692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (d1b63b29-2bb0-4984-9c04-e7daa74698cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c73ac411-219b-4cac-ba38-cca020a97e74 tempest-CreateVolumesFromSnapshotTest-916638669 None] Created volume successfully.
Nov 05 04:28:09 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516 1073741824" returned: 0 in 0.845s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:09 devstack sudo[102192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516
Nov 05 04:28:09 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:09 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:28:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb37827-8286-43ed-8a8c-c12f7ccd3154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93c0c7e2-722a-4fde-9950-5839fbbcc516', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd120173-e571-4bac-a941-a732b60489b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Volume volume-93c0c7e2-722a-4fde-9950-5839fbbcc516 (93c0c7e2-722a-4fde-9950-5839fbbcc516): created successfully
Nov 05 04:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd120173-e571-4bac-a941-a732b60489b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Flow 'volume_create_manager' (4361d4bd-bf55-45ea-ae3b-fabfd0567941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-248fa605-4557-47bb-9f44-4c56504ae643 tempest-CreateVolumesFromSnapshotTest-916638669 None] Created volume successfully.
Nov 05 04:28:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-93c0c7e2-722a-4fde-9950-5839fbbcc516-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-93c0c7e2-722a-4fde-9950-5839fbbcc516-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-quobyte-93c0c7e2-722a-4fde-9950-5839fbbcc516" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-93c0c7e2-722a-4fde-9950-5839fbbcc516" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[69077e7b-5b4b-4598-abd1-a906636a1ff8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:10 devstack sudo[102196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516
Nov 05 04:28:10 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:10 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516" returned: 0 in 0.587s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:11 devstack sudo[102202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516
Nov 05 04:28:11 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:11 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-93c0c7e2-722a-4fde-9950-5839fbbcc516" returned: 0 in 0.528s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-93c0c7e2-722a-4fde-9950-5839fbbcc516" released by "delete_volume" :: held 1.201s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:11 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Created reservations ['6827484c-0dea-413e-b0db-fc87a222cde7', '390b707d-66c8-4f0a-a591-3e915b0db0ea', '3cb0c352-d75f-478c-8714-1fe32924c46a', 'd8031a38-7e82-493e-8c4c-c886e2d3b2ac'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:28:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:11 devstack sudo[102207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:28:11 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:12 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:28:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Deleted volume successfully.
Nov 05 04:28:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-82e039f1-3b18-4257-9a07-0be8d676eb92 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-93c0c7e2-722a-4fde-9950-5839fbbcc516-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-de76e5ae-e791-4992-9ed4-52ecb038a007-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-de76e5ae-e791-4992-9ed4-52ecb038a007-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-quobyte-de76e5ae-e791-4992-9ed4-52ecb038a007" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-de76e5ae-e791-4992-9ed4-52ecb038a007" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:12 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4f3af0-aa7b-43d7-9d8e-7360836349ab]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:12 devstack sudo[102216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007
Nov 05 04:28:12 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:13 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007" returned: 0 in 0.577s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:13 devstack sudo[102222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007
Nov 05 04:28:13 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:13 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de76e5ae-e791-4992-9ed4-52ecb038a007" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-de76e5ae-e791-4992-9ed4-52ecb038a007" released by "delete_volume" :: held 1.007s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Created reservations ['3f86f3ce-e270-4600-9e60-1e40521c5752', '82df9201-d0fa-4c34-b7e0-7fd1c3c31496', 'f199ebff-454c-4d05-b14b-dd4dfca1fff0', '63d81818-d0e7-4c56-bf72-21db488c7533'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:13 devstack sudo[102261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:28:13 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:14 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:14 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:28:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Deleted volume successfully.
Nov 05 04:28:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f74dd694-fcc1-4e94-8bda-7adfb222acd3 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-de76e5ae-e791-4992-9ed4-52ecb038a007-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-ed7880d3-14a9-4b23-9b1d-da8c299d76a9-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-ed7880d3-14a9-4b23-9b1d-da8c299d76a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-quobyte-ed7880d3-14a9-4b23-9b1d-da8c299d76a9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-ed7880d3-14a9-4b23-9b1d-da8c299d76a9" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42c448d-0274-4237-87ea-25280def920b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:15 devstack sudo[102268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9
Nov 05 04:28:15 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:15 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9" returned: 0 in 0.465s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:15 devstack sudo[102273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9
Nov 05 04:28:15 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:15 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ed7880d3-14a9-4b23-9b1d-da8c299d76a9" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-ed7880d3-14a9-4b23-9b1d-da8c299d76a9" released by "delete_volume" :: held 0.880s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Created reservations ['435b2c8a-0a5c-4fe0-bf1d-6b0d36f187da', '8d1d0526-ea4b-4031-b1ba-fb2f69d4de4f', '73aa06e3-45ab-48a6-a65b-f140b3c994ab', '80caca40-13ec-4244-921c-98036c8cc5e4'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:16 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:28:16 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-dfede743-f642-4898-8c06-24e78f6fdc5f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-dfede743-f642-4898-8c06-24e78f6fdc5f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-quobyte-dfede743-f642-4898-8c06-24e78f6fdc5f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-dfede743-f642-4898-8c06-24e78f6fdc5f" acquired by "delete_volume" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fb9d12-955e-4357-acfd-94e3f6c8bd46]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:16 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:28:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Deleted volume successfully.
Nov 05 04:28:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec8a0e04-db1a-4a61-9fe6-f37ce5ab9964 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-ed7880d3-14a9-4b23-9b1d-da8c299d76a9-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:16 devstack sudo[102279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f
Nov 05 04:28:16 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:17 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f" returned: 0 in 0.547s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:17 devstack sudo[102285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f
Nov 05 04:28:17 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:17 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-dfede743-f642-4898-8c06-24e78f6fdc5f" returned: 0 in 0.373s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-dfede743-f642-4898-8c06-24e78f6fdc5f" released by "delete_volume" :: held 1.021s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Created reservations ['be17e884-f6cd-4ba4-bf21-e8e0e282e79a', '73c9e5d0-21e8-46e4-abf9-5a8ba8d27471', '384880d4-3570-40bd-bb4b-718fbaa6170f', 'dcde8add-f4ff-4a3e-9532-a9add38670fa'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:17 devstack sudo[102313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:28:17 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:17 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.306s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:28:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Deleted volume successfully.
Nov 05 04:28:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-8be52b12-d5ad-45fd-9b97-c792204a6ee8 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-dfede743-f642-4898-8c06-24e78f6fdc5f-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-713ee5aa-786a-4143-a7ec-10ed3b15f927-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-713ee5aa-786a-4143-a7ec-10ed3b15f927-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-quobyte-713ee5aa-786a-4143-a7ec-10ed3b15f927" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-713ee5aa-786a-4143-a7ec-10ed3b15f927" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11461d4-1253-45a2-9ef9-d32586c4c256]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:18 devstack sudo[102336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927
Nov 05 04:28:18 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:19 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927" returned: 0 in 0.437s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:19 devstack sudo[102342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927
Nov 05 04:28:19 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:19 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-713ee5aa-786a-4143-a7ec-10ed3b15f927" returned: 0 in 0.488s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-713ee5aa-786a-4143-a7ec-10ed3b15f927" released by "delete_volume" :: held 0.998s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Created reservations ['a1b74d31-9e91-4078-83e4-36bdc1b176b5', '9b36a3c1-e4d5-4d36-8730-ad1cac1d8bdc', 'e92e11e5-f690-4034-9ab9-45b520ebbc18', '34c8c1e1-ab2a-4515-be3e-a2a4add17dfe'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:19 devstack sudo[102402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:28:19 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:20 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.405s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:28:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Deleted volume successfully.
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f5cae02b-5fdb-41f2-9e95-a28e80fab384 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-713ee5aa-786a-4143-a7ec-10ed3b15f927-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-72e0dc1d-0f06-4e4a-9660-6bcc133e291c-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-72e0dc1d-0f06-4e4a-9660-6bcc133e291c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-quobyte-33d2c58c-3bce-446c-9899-11a22b1c466b" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-33d2c58c-3bce-446c-9899-11a22b1c466b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-quobyte-72e0dc1d-0f06-4e4a-9660-6bcc133e291c" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-72e0dc1d-0f06-4e4a-9660-6bcc133e291c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Deleting offline snapshot 72e0dc1d-0f06-4e4a-9660-6bcc133e291c of volume 33d2c58c-3bce-446c-9899-11a22b1c466b {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:28:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] snapshot_file for this snap is: volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:28:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[052585cf-e025-4328-962b-295f9ef78504]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:21 devstack sudo[102418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c
Nov 05 04:28:21 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:21 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c" returned: 0 in 0.524s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33d2c58c-3bce-446c-9899-11a22b1c466b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:28:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7a2632-94f6-4a43-88c7-12313a365530]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:21 devstack sudo[102423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b
Nov 05 04:28:21 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:22 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b" returned: 0 in 0.587s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:22 devstack sudo[102428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c
Nov 05 04:28:22 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:22 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c" returned: 0 in 0.623s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:22 devstack sudo[102433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c
Nov 05 04:28:22 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:23 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b.72e0dc1d-0f06-4e4a-9660-6bcc133e291c" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-72e0dc1d-0f06-4e4a-9660-6bcc133e291c" released by "_delete_snapshot" :: held 2.372s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-33d2c58c-3bce-446c-9899-11a22b1c466b" released by "delete_snapshot" :: held 2.417s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:23 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Created reservations ['b9b8f7f1-16c9-4475-b94d-e59802b3e9d7', 'b36682f5-8753-48d7-b2cf-f7c1e5066155', '263fb3ba-a8a3-4031-b36c-7ae4c3a4c129', 'f179bca2-afdd-42ae-bf40-ded80baed1ff'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:28:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Delete snapshot completed successfully.
Nov 05 04:28:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3e525a98-82a7-4e64-952b-f48b290582ba tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-72e0dc1d-0f06-4e4a-9660-6bcc133e291c-delete_snapshot" released by "delete_snapshot" :: held 2.690s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-33d2c58c-3bce-446c-9899-11a22b1c466b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-33d2c58c-3bce-446c-9899-11a22b1c466b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Flow 'volume_create_manager' (620d39aa-6dc8-4f87-bdfa-c96b00c19474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454187ac-4d56-4b38-bf2a-345a3fcc8df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "cinder-quobyte-33d2c58c-3bce-446c-9899-11a22b1c466b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (454187ac-4d56-4b38-bf2a-345a3fcc8df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-641117967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080d8794-6412-473d-b984-d78c589b4e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab95913252ff4dd69ff9ac6a59270a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:24Z,use_quota=True,user_id='6198fd5dedf14885b4fabee5637c03e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a42e096-8935-4f73-b630-b9db88f63e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a42e096-8935-4f73-b630-b9db88f63e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c8b94c-668e-4076-a421-e7f234203bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c8b94c-668e-4076-a421-e7f234203bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '080d8794-6412-473d-b984-d78c589b4e91', 'volume_name': 'volume-080d8794-6412-473d-b984-d78c589b4e91', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca76a37f-97ca-453e-8161-91588fe230b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca76a37f-97ca-453e-8161-91588fe230b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e32132-e443-4a2d-a7a9-c82451276380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Volume 080d8794-6412-473d-b984-d78c589b4e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-080d8794-6412-473d-b984-d78c589b4e91', 'volume_size': 1}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-641117967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=080d8794-6412-473d-b984-d78c589b4e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab95913252ff4dd69ff9ac6a59270a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:24Z,use_quota=True,user_id='6198fd5dedf14885b4fabee5637c03e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Creating volume 080d8794-6412-473d-b984-d78c589b4e91 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:28:24 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-33d2c58c-3bce-446c-9899-11a22b1c466b" acquired by "delete_volume" :: waited 0.203s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:24 devstack sudo[102455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91 1073741824
Nov 05 04:28:24 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae35a6cb-2381-424c-96a1-1da14b276d80]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:25 devstack sudo[102457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b
Nov 05 04:28:25 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:25 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91 1073741824" returned: 0 in 0.742s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:25 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b" returned: 0 in 0.735s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:25 devstack sudo[102468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91
Nov 05 04:28:25 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:25 devstack sudo[102469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b
Nov 05 04:28:25 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:26 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:26 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76e32132-e443-4a2d-a7a9-c82451276380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-080d8794-6412-473d-b984-d78c589b4e91', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5664498c-ad33-4aa7-98ff-0f2d1985c154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-33d2c58c-3bce-446c-9899-11a22b1c466b" returned: 0 in 0.451s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-quobyte-33d2c58c-3bce-446c-9899-11a22b1c466b" released by "delete_volume" :: held 1.326s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:26 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Volume volume-080d8794-6412-473d-b984-d78c589b4e91 (080d8794-6412-473d-b984-d78c589b4e91): created successfully
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5664498c-ad33-4aa7-98ff-0f2d1985c154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Flow 'volume_create_manager' (620d39aa-6dc8-4f87-bdfa-c96b00c19474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6b781604-5993-4739-9337-2888bec4b7b2 tempest-TestMinimumBasicScenario-1161422390 None] Created volume successfully.
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Created reservations ['ca1a2593-a0ef-422d-93ab-019af263d41c', '1208d915-7b28-4005-a49c-2a5f2ddd3e55', 'a0ac8a39-17a5-48eb-af2d-cf1cbff08006', 'b832d5fa-1c66-43a2-b31b-9b56e57f0709'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:26 devstack sudo[102479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:28:26 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:27 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.681s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:27 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:28:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Deleted volume successfully.
Nov 05 04:28:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd0a5690-96a0-4f54-9f00-6f6dca87cf31 tempest-CreateVolumesFromSnapshotTest-916638669 None] Lock "cinder-33d2c58c-3bce-446c-9899-11a22b1c466b-delete_volume" released by "delete_volume" :: held 2.720s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-90360a00-99d0-46d3-95d5-67e14ef48c5a req-4fa64478-5e65-4023-bfa4-0d3d4c63d963 tempest-TestMinimumBasicScenario-1161422390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-90360a00-99d0-46d3-95d5-67e14ef48c5a req-4fa64478-5e65-4023-bfa4-0d3d4c63d963 tempest-TestMinimumBasicScenario-1161422390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-90360a00-99d0-46d3-95d5-67e14ef48c5a req-4fa64478-5e65-4023-bfa4-0d3d4c63d963 tempest-TestMinimumBasicScenario-1161422390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-90360a00-99d0-46d3-95d5-67e14ef48c5a req-4fa64478-5e65-4023-bfa4-0d3d4c63d963 tempest-TestMinimumBasicScenario-1161422390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-080d8794-6412-473d-b984-d78c589b4e91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93408ff1-6cfa-4ce1-9033-78c1ee4516f7', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:28:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-90360a00-99d0-46d3-95d5-67e14ef48c5a req-4fa64478-5e65-4023-bfa4-0d3d4c63d963 tempest-TestMinimumBasicScenario-1161422390 None] attachment_update completed successfully.
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:29 devstack sudo[102511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:28:29 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:29 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:28:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-a0cb0f1a-8352-4125-8804-7558b6758249 req-40a24a3f-a2e0-4a18-831c-78518a1d2bc8 tempest-TestShelveInstance-780228114 None] Terminate volume connection completed successfully.
Nov 05 04:28:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-a0cb0f1a-8352-4125-8804-7558b6758249 req-40a24a3f-a2e0-4a18-831c-78518a1d2bc8 tempest-TestShelveInstance-780228114 None] Deleting attachment ad2fd383-87ab-4169-92db-bd75c6ce8a81. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-3d9da1ba-e8dc-4177-bdaf-c3cf3d784385 req-374520da-9d4c-427a-9d7b-129488afeb6e tempest-TestShelveInstance-780228114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-3d9da1ba-e8dc-4177-bdaf-c3cf3d784385 req-374520da-9d4c-427a-9d7b-129488afeb6e tempest-TestShelveInstance-780228114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-3d9da1ba-e8dc-4177-bdaf-c3cf3d784385 req-374520da-9d4c-427a-9d7b-129488afeb6e tempest-TestShelveInstance-780228114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-3d9da1ba-e8dc-4177-bdaf-c3cf3d784385 req-374520da-9d4c-427a-9d7b-129488afeb6e tempest-TestShelveInstance-780228114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-995ab850-0488-4ae9-97e3-0ccc76563083', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16bee2b9-e4bd-4698-a3e3-6f2ddf33c43e', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:28:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-3d9da1ba-e8dc-4177-bdaf-c3cf3d784385 req-374520da-9d4c-427a-9d7b-129488afeb6e tempest-TestShelveInstance-780228114 None] attachment_update completed successfully.
Nov 05 04:28:35 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Flow 'volume_create_manager' (d50bab94-9599-4b44-8614-76b033b1424d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c30c591-feb4-4afd-acad-02245bcd7c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c30c591-feb4-4afd-acad-02245bcd7c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-222724699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92aeddab-e5c7-4350-9ba9-756b40f8b5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe0db1c309549e9a4eebad7159fa6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:36Z,use_quota=True,user_id='f33e0fa4f99f4b8abef81d8d52d4967b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e7b9d-bf9a-4a1b-b140-224c4694a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34e7b9d-bf9a-4a1b-b140-224c4694a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbbc4fa-83ca-4c7c-a1e6-3446017bc486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbbbc4fa-83ca-4c7c-a1e6-3446017bc486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92aeddab-e5c7-4350-9ba9-756b40f8b5e6', 'volume_name': 'volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f20a02c0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f865013e-b788-42e7-966c-be3e4ccc611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f865013e-b788-42e7-966c-be3e4ccc611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d4756a-78e5-40eb-bb8b-bbad7f0a892c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:36 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Volume 92aeddab-e5c7-4350-9ba9-756b40f8b5e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f20a02c0>}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Trying to clone 92aeddab-e5c7-4350-9ba9-756b40f8b5e6 from image 6ded3d1d-d482-4fc8-985e-41c27b256803 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:28:36 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:28:36 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Image download 20.69 MB at 20.69 MB/s
Nov 05 04:28:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9c51fd-c8cd-4e3c-bec2-ce75ef2f8f34]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:37 devstack sudo[102587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD
Nov 05 04:28:37 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:37 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:37 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 is fetched for user f33e0fa4f99f4b8abef81d8d52d4967b. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:28:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8bf61d-4754-4e32-a466-69717ef04a09]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:37 devstack sudo[102593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD
Nov 05 04:28:37 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Flow 'volume_create_manager' (26f95674-21c0-44ee-acc4-0402309720cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292a8433-2cef-47bb-ae99-1c2a80f05949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292a8433-2cef-47bb-ae99-1c2a80f05949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4dc39a3-5f8a-4852-bb63-4dd1117c4c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06acc75c5f064f48929b7d3be5f85352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:38Z,use_quota=True,user_id='892d1145d44c4c33964da24536376549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbaf00f-4003-47e8-8af4-31473b9771f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efbaf00f-4003-47e8-8af4-31473b9771f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070c627a-6b73-4d41-bdf3-70d73d103751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:28:38 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-222724699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92aeddab-e5c7-4350-9ba9-756b40f8b5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfe0db1c309549e9a4eebad7159fa6e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:36Z,use_quota=True,user_id='f33e0fa4f99f4b8abef81d8d52d4967b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Creating volume 92aeddab-e5c7-4350-9ba9-756b40f8b5e6 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:28:38 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:38 devstack sudo[102599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 1073741824
Nov 05 04:28:38 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070c627a-6b73-4d41-bdf3-70d73d103751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4dc39a3-5f8a-4852-bb63-4dd1117c4c53', 'volume_name': 'volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53', 'volume_size': 1, 'image_id': '482bf863-663a-436e-b1b8-b9e2ea113391', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/482bf863-663a-436e-b1b8-b9e2ea113391', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd34d4376bffe42b9b27ef1943709246c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06acc75c5f064f48929b7d3be5f85352', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3926a31207159b26422a4043a030df1943e118c951681476c2ca49ad8faeef01c851b09f48b2d7e91e3e78adc0c487ff1bcbeec6331c1ff771f8f19f36187c8', 'id': '482bf863-663a-436e-b1b8-b9e2ea113391', 'created_at': datetime.datetime(2026, 11, 5, 3, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/482bf863-663a-436e-b1b8-b9e2ea113391/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f21893a0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6e6401-db07-4ef2-91ea-cf5ecc7ebccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6e6401-db07-4ef2-91ea-cf5ecc7ebccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4a757d-80b2-4008-a023-fdfd47299fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Volume f4dc39a3-5f8a-4852-bb63-4dd1117c4c53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53', 'volume_size': 1, 'image_id': '482bf863-663a-436e-b1b8-b9e2ea113391', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/482bf863-663a-436e-b1b8-b9e2ea113391', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd34d4376bffe42b9b27ef1943709246c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06acc75c5f064f48929b7d3be5f85352', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3926a31207159b26422a4043a030df1943e118c951681476c2ca49ad8faeef01c851b09f48b2d7e91e3e78adc0c487ff1bcbeec6331c1ff771f8f19f36187c8', 'id': '482bf863-663a-436e-b1b8-b9e2ea113391', 'created_at': datetime.datetime(2026, 11, 5, 3, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/482bf863-663a-436e-b1b8-b9e2ea113391/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f21893a0>}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Trying to clone f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 from image 482bf863-663a-436e-b1b8-b9e2ea113391 at location (None, [{'url': 'file:///opt/stack/data/glance/images/482bf863-663a-436e-b1b8-b9e2ea113391', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:28:38 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab66fd9d-2110-4d12-b8ec-ed40dcd69ecd]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:38 devstack sudo[102605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD
Nov 05 04:28:38 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:38 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 1073741824" returned: 0 in 0.669s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:39 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6
Nov 05 04:28:39 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:39 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD" returned: 0 in 0.576s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:39 devstack sudo[102623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD
Nov 05 04:28:39 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:39 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6" returned: 0 in 0.555s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Attempting download of 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume 92aeddab-e5c7-4350-9ba9-756b40f8b5e6. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f69123-4efd-444d-a87c-44483224dc61]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_iq6u7zm0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:39 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD" returned: 1 in 0.590s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:28:39 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Temporary image 482bf863-663a-436e-b1b8-b9e2ea113391 is fetched for user 892d1145d44c4c33964da24536376549. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:28:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6594e5e-c0c6-4b3b-b74b-ad468f2f8d9a]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:40 devstack sudo[102660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_iq6u7zm0
Nov 05 04:28:40 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:40 devstack sudo[102676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD
Nov 05 04:28:40 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:40 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_iq6u7zm0" returned: 0 in 0.620s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_iq6u7zm0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:40 devstack sudo[102687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_iq6u7zm0
Nov 05 04:28:40 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:40 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD" returned: 0 in 0.587s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:40 devstack sudo[102693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD
Nov 05 04:28:40 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:41 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_iq6u7zm0" returned: 1 in 0.552s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ded3d1d-d482-4fc8-985e-41c27b256803_iq6u7zm0' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9935f2-7fb9-4ee1-b0b3-0a8c4db7e4be]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:41 devstack sudo[102698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD
Nov 05 04:28:41 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:41 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD" returned: 1 in 0.529s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4dc39a3-5f8a-4852-bb63-4dd1117c4c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06acc75c5f064f48929b7d3be5f85352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:38Z,use_quota=True,user_id='892d1145d44c4c33964da24536376549',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Creating volume f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:28:41 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:41 devstack sudo[102705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 1073741824
Nov 05 04:28:41 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:41 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD" returned: 0 in 0.706s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] 6ded3d1d-d482-4fc8-985e-41c27b256803 was qcow2, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:28:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:41 devstack sudo[102713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6
Nov 05 04:28:41 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:42 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 1073741824" returned: 0 in 0.929s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:42 devstack sudo[102721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53
Nov 05 04:28:42 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:42 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53" returned: 0 in 0.518s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:28:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:43 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Attempting download of 482bf863-663a-436e-b1b8-b9e2ea113391 ((None, [{'url': 'file:///opt/stack/data/glance/images/482bf863-663a-436e-b1b8-b9e2ea113391', 'metadata': {}}])) to volume f4dc39a3-5f8a-4852-bb63-4dd1117c4c53. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:28:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a32191a-b6a2-47dd-85ec-b8cecfc56119]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_482bf863-663a-436e-b1b8-b9e2ea113391_kr37nl2g {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:43 devstack sudo[102726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_482bf863-663a-436e-b1b8-b9e2ea113391_kr37nl2g
Nov 05 04:28:43 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:43 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_482bf863-663a-436e-b1b8-b9e2ea113391_kr37nl2g" returned: 0 in 0.483s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_482bf863-663a-436e-b1b8-b9e2ea113391_kr37nl2g {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:43 devstack sudo[102731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_482bf863-663a-436e-b1b8-b9e2ea113391_kr37nl2g
Nov 05 04:28:43 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:44 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_482bf863-663a-436e-b1b8-b9e2ea113391_kr37nl2g" returned: 1 in 0.452s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_482bf863-663a-436e-b1b8-b9e2ea113391_kr37nl2g' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:28:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[256b6a30-fa1e-416b-8e19-965a32f3ac62]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:44 devstack sudo[102735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD
Nov 05 04:28:44 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:44 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:44 devstack sudo[102739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD
Nov 05 04:28:44 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:44 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6" returned: 0 in 3.065s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:44 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ded3d1d-d482-4fc8-985e-41c27b256803_x1le5x4kdevstack@QuobyteHD, size 112.00 MB, duration 3.07 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:28:44 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Converted 112.00 MB image at 36.52 MB/s
Nov 05 04:28:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:44 devstack sudo[102741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 1G
Nov 05 04:28:44 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:45 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD" returned: 1 in 0.520s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] 482bf863-663a-436e-b1b8-b9e2ea113391 was raw, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:45 devstack sudo[102748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53
Nov 05 04:28:45 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:45 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 1G" returned: 0 in 0.482s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Downloaded image 6ded3d1d-d482-4fc8-985e-41c27b256803 ((None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}])) to volume 92aeddab-e5c7-4350-9ba9-756b40f8b5e6 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Temporary image 6ded3d1d-d482-4fc8-985e-41c27b256803 for user f33e0fa4f99f4b8abef81d8d52d4967b is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Marking volume 92aeddab-e5c7-4350-9ba9-756b40f8b5e6 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Copying metadata from image 6ded3d1d-d482-4fc8-985e-41c27b256803 to 92aeddab-e5c7-4350-9ba9-756b40f8b5e6. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Creating volume glance metadata for volume 92aeddab-e5c7-4350-9ba9-756b40f8b5e6 backed by image 6ded3d1d-d482-4fc8-985e-41c27b256803 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d4756a-78e5-40eb-bb8b-bbad7f0a892c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6', 'volume_size': 1, 'image_id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ded3d1d-d482-4fc8-985e-41c27b256803', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0d3c3039bb3492c8bdd43d06787fa62', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6ded3d1d-d482-4fc8-985e-41c27b256803', 'created_at': datetime.datetime(2026, 11, 5, 3, 9, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ded3d1d-d482-4fc8-985e-41c27b256803/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f20a02c0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09206b10-2089-4fdd-9129-1fd40f923823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Volume volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 (92aeddab-e5c7-4350-9ba9-756b40f8b5e6): created successfully
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09206b10-2089-4fdd-9129-1fd40f923823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Flow 'volume_create_manager' (d50bab94-9599-4b44-8614-76b033b1424d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-74296fe0-5e2b-414f-a4f5-209d6de2c860 tempest-VolumesImageMetadata-549961614 None] Created volume successfully.
Nov 05 04:28:45 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53" returned: 0 in 0.770s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_482bf863-663a-436e-b1b8-b9e2ea113391_ni_dq_b7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:28:45 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:28:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:45 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 1G
Nov 05 04:28:45 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:46 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 1G" returned: 0 in 0.522s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Downloaded image 482bf863-663a-436e-b1b8-b9e2ea113391 ((None, [{'url': 'file:///opt/stack/data/glance/images/482bf863-663a-436e-b1b8-b9e2ea113391', 'metadata': {}}])) to volume f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Temporary image 482bf863-663a-436e-b1b8-b9e2ea113391 for user 892d1145d44c4c33964da24536376549 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Marking volume f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Copying metadata from image 482bf863-663a-436e-b1b8-b9e2ea113391 to f4dc39a3-5f8a-4852-bb63-4dd1117c4c53. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Creating volume glance metadata for volume f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 backed by image 482bf863-663a-436e-b1b8-b9e2ea113391 with: {'image_id': '482bf863-663a-436e-b1b8-b9e2ea113391', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd34d4376bffe42b9b27ef1943709246c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4a757d-80b2-4008-a023-fdfd47299fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53', 'volume_size': 1, 'image_id': '482bf863-663a-436e-b1b8-b9e2ea113391', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/482bf863-663a-436e-b1b8-b9e2ea113391', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd34d4376bffe42b9b27ef1943709246c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06acc75c5f064f48929b7d3be5f85352', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3926a31207159b26422a4043a030df1943e118c951681476c2ca49ad8faeef01c851b09f48b2d7e91e3e78adc0c487ff1bcbeec6331c1ff771f8f19f36187c8', 'id': '482bf863-663a-436e-b1b8-b9e2ea113391', 'created_at': datetime.datetime(2026, 11, 5, 3, 28, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 28, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/482bf863-663a-436e-b1b8-b9e2ea113391/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f21893a0>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca0486f-8172-4024-bcaa-726831dcf4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:46 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Volume volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 (f4dc39a3-5f8a-4852-bb63-4dd1117c4c53): created successfully
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca0486f-8172-4024-bcaa-726831dcf4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Flow 'volume_create_manager' (26f95674-21c0-44ee-acc4-0402309720cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a27b7e89-42b3-43a6-9932-aa1c0a710c63 tempest-VolumeImageDependencyTests-947815019 None] Created volume successfully.
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Acquiring lock "cinder-92aeddab-e5c7-4350-9ba9-756b40f8b5e6-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Lock "cinder-92aeddab-e5c7-4350-9ba9-756b40f8b5e6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Acquiring lock "cinder-quobyte-92aeddab-e5c7-4350-9ba9-756b40f8b5e6" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Lock "cinder-quobyte-92aeddab-e5c7-4350-9ba9-756b40f8b5e6" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c69d458-f4c2-4dd8-9d5e-597e9c6b0ada]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:46 devstack sudo[102762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6
Nov 05 04:28:46 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:47 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:47 devstack sudo[102767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6
Nov 05 04:28:47 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Acquiring lock "cinder-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Lock "cinder-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Acquiring lock "cinder-quobyte-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Lock "cinder-quobyte-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d944882-2a8b-4b82-96cb-f3562cc1a663]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:47 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:47 devstack sudo[102769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53
Nov 05 04:28:47 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-92aeddab-e5c7-4350-9ba9-756b40f8b5e6" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Lock "cinder-quobyte-92aeddab-e5c7-4350-9ba9-756b40f8b5e6" released by "delete_volume" :: held 0.795s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Created reservations ['d4be5c75-3166-4f6f-baf9-4100a6be9399', '9c577225-a0df-4495-bad7-636cd65d7230', '74c4b959-ffc2-4d0d-b18b-5b5156feb1e4', '624047f2-1d62-4aba-a009-b9f1fb950919'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:47 devstack sudo[102772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:28:47 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:47 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53" returned: 0 in 0.454s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:47 devstack sudo[102777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53
Nov 05 04:28:47 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:47 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.329s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:47 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:28:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Deleted volume successfully.
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-93e08163-e99a-4cad-85c1-8ada551363e2 tempest-VolumesImageMetadata-549961614 None] Lock "cinder-92aeddab-e5c7-4350-9ba9-756b40f8b5e6-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:48 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53" returned: 0 in 0.393s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Lock "cinder-quobyte-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53" released by "delete_volume" :: held 0.892s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Created reservations ['d1cc1d81-70fb-4618-a746-ba37212efddd', 'ec9596df-da03-4488-b02a-9494306a81da', 'e5fe5e02-2f0b-41be-b4a8-0a06a4ffa042', '45f33c4f-cf53-4cfb-8b5f-832e3f449a74'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:48 devstack sudo[102781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:28:48 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:48 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:28:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Deleted volume successfully.
Nov 05 04:28:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-da314b0c-8bb3-4bc7-a609-63e2128a9095 tempest-VolumeImageDependencyTests-947815019 None] Lock "cinder-f4dc39a3-5f8a-4852-bb63-4dd1117c4c53-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Flow 'volume_create_manager' (3c7ea3e4-bf50-4aea-9807-553795dff3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff69ede-b4a9-44b9-aae3-27c4f0d1b18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ff69ede-b4a9-44b9-aae3-27c4f0d1b18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1253378930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3519db0c-23c9-4485-93dd-cfa46b834188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab2fb6a8514c7692713453c01bc7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:56Z,use_quota=True,user_id='5a642d6fa8b94222871330bc27ea2642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e602a8-ac0c-4f21-90b8-1fa3f9ec8ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e602a8-ac0c-4f21-90b8-1fa3f9ec8ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cfa7c9-77ff-497d-b80a-52beba1e1caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cfa7c9-77ff-497d-b80a-52beba1e1caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3519db0c-23c9-4485-93dd-cfa46b834188', 'volume_name': 'volume-3519db0c-23c9-4485-93dd-cfa46b834188', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a4f2b1-3528-4d13-a440-e849dd08a5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a4f2b1-3528-4d13-a440-e849dd08a5ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bf6f07-1c1c-434c-98fb-a974e441bec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Volume 3519db0c-23c9-4485-93dd-cfa46b834188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3519db0c-23c9-4485-93dd-cfa46b834188', 'volume_size': 1}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1253378930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3519db0c-23c9-4485-93dd-cfa46b834188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab2fb6a8514c7692713453c01bc7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:28:56Z,use_quota=True,user_id='5a642d6fa8b94222871330bc27ea2642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Creating volume 3519db0c-23c9-4485-93dd-cfa46b834188 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:28:55 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:28:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:55 devstack sudo[102814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188 1073741824
Nov 05 04:28:55 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:56 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188 1073741824" returned: 0 in 0.672s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:56 devstack sudo[102820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188
Nov 05 04:28:56 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:57 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:28:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2bf6f07-1c1c-434c-98fb-a974e441bec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3519db0c-23c9-4485-93dd-cfa46b834188', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1272da0a-985d-49f0-a686-f77f92097705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:28:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Volume volume-3519db0c-23c9-4485-93dd-cfa46b834188 (3519db0c-23c9-4485-93dd-cfa46b834188): created successfully
Nov 05 04:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1272da0a-985d-49f0-a686-f77f92097705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:28:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Flow 'volume_create_manager' (3c7ea3e4-bf50-4aea-9807-553795dff3b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:28:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ba1620ea-adbc-4ba5-a4a5-062c99fb5fc5 tempest-VolumesTransfersV355Test-782850257 None] Created volume successfully.
Nov 05 04:28:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-714e6030-4f94-4981-a817-92931891f4e7 tempest-VolumesTransfersV355Test-20262564 None] Transfer volume completed successfully.
Nov 05 04:28:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Acquiring lock "cinder-3519db0c-23c9-4485-93dd-cfa46b834188-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Lock "cinder-3519db0c-23c9-4485-93dd-cfa46b834188-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Acquiring lock "cinder-quobyte-3519db0c-23c9-4485-93dd-cfa46b834188" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:28:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Lock "cinder-quobyte-3519db0c-23c9-4485-93dd-cfa46b834188" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:28:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7d78db-95b1-4c6d-b84f-24e08f44d700]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:28:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:59 devstack sudo[102823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188
Nov 05 04:28:59 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:28:59 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root
Nov 05 04:28:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188" returned: 0 in 0.363s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:28:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:28:59 devstack sudo[102829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188
Nov 05 04:28:59 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:00 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3519db0c-23c9-4485-93dd-cfa46b834188" returned: 0 in 0.254s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Lock "cinder-quobyte-3519db0c-23c9-4485-93dd-cfa46b834188" released by "delete_volume" :: held 0.674s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Created reservations ['ff1cc17b-dd9a-4226-89f3-1a931db62e55', '98b6fe18-8f64-48cc-9fef-b27fd9123050', 'b72efe72-2aea-48bc-a6e6-2eea3ad2070a', '22706588-c477-4549-b527-3707af294202'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:00 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:29:00 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:00 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:29:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Deleted volume successfully.
Nov 05 04:29:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c09c604e-4e9b-43be-8a91-3bb53b580c9f tempest-VolumesTransfersV355Test-154789899 None] Lock "cinder-3519db0c-23c9-4485-93dd-cfa46b834188-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Flow 'volume_create_manager' (75014694-0f40-4214-9a9c-e955fe419e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f9c2db-139e-4781-90e0-b4c44f2d8eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82f9c2db-139e-4781-90e0-b4c44f2d8eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-917429940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fd0fbb-75c1-4267-8bf7-396e7877522c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab2fb6a8514c7692713453c01bc7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:01Z,use_quota=True,user_id='5a642d6fa8b94222871330bc27ea2642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbd06bb-7074-4b08-a47c-45a8fd9bb9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dbd06bb-7074-4b08-a47c-45a8fd9bb9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebf5fa9-165f-429d-b90d-7f8d49ed5d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebf5fa9-165f-429d-b90d-7f8d49ed5d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30fd0fbb-75c1-4267-8bf7-396e7877522c', 'volume_name': 'volume-30fd0fbb-75c1-4267-8bf7-396e7877522c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1215ac65-8e18-4417-820b-7c101df4ee55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1215ac65-8e18-4417-820b-7c101df4ee55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bc436e-79d3-406c-b8ab-8df161734ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Volume 30fd0fbb-75c1-4267-8bf7-396e7877522c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30fd0fbb-75c1-4267-8bf7-396e7877522c', 'volume_size': 1}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-917429940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30fd0fbb-75c1-4267-8bf7-396e7877522c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9ab2fb6a8514c7692713453c01bc7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:01Z,use_quota=True,user_id='5a642d6fa8b94222871330bc27ea2642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Creating volume 30fd0fbb-75c1-4267-8bf7-396e7877522c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:29:01 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:01 devstack sudo[102835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c 1073741824
Nov 05 04:29:01 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:01 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c 1073741824" returned: 0 in 0.420s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:01 devstack sudo[102840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c
Nov 05 04:29:01 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:01 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26bc436e-79d3-406c-b8ab-8df161734ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30fd0fbb-75c1-4267-8bf7-396e7877522c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2682f21-1823-4b85-9eb2-648176bbeec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Volume volume-30fd0fbb-75c1-4267-8bf7-396e7877522c (30fd0fbb-75c1-4267-8bf7-396e7877522c): created successfully
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2682f21-1823-4b85-9eb2-648176bbeec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Flow 'volume_create_manager' (75014694-0f40-4214-9a9c-e955fe419e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6ba23ee2-7166-4275-b34c-ed5b0ebeea86 tempest-VolumesTransfersV355Test-782850257 None] Created volume successfully.
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Acquiring lock "cinder-30fd0fbb-75c1-4267-8bf7-396e7877522c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Lock "cinder-30fd0fbb-75c1-4267-8bf7-396e7877522c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Acquiring lock "cinder-quobyte-30fd0fbb-75c1-4267-8bf7-396e7877522c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Lock "cinder-quobyte-30fd0fbb-75c1-4267-8bf7-396e7877522c" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346e9a6-4c3f-4a02-8872-0c70b5eb96f4]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:02 devstack sudo[102843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c
Nov 05 04:29:02 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:02 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:03 devstack sudo[102848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c
Nov 05 04:29:03 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:03 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30fd0fbb-75c1-4267-8bf7-396e7877522c" returned: 0 in 0.262s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Lock "cinder-quobyte-30fd0fbb-75c1-4267-8bf7-396e7877522c" released by "delete_volume" :: held 0.691s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Created reservations ['7b811eef-4e5c-4e27-8afe-fed50d53b620', '23d4c464-ab91-4a6b-88bf-01cef57b69da', 'e2f5fb9e-1707-4fb3-a7ac-d8f0744475a0', 'e5ee2046-9830-424e-8c5e-d8fa9cb37494'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:03 devstack sudo[102851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:29:03 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:03 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:29:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Deleted volume successfully.
Nov 05 04:29:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dacaae2f-8cb9-4d50-9514-276b3bf6ff68 tempest-VolumesTransfersV355Test-154789899 None] Lock "cinder-30fd0fbb-75c1-4267-8bf7-396e7877522c-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=120,cinder:DELETE=10,cinder:SELECT=90,cinder:INSERT=38 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=100,cinder:INSERT=34,cinder:UPDATE=102,cinder:DELETE=7 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Flow 'volume_create_manager' (945626fd-e8f1-461d-8444-02f02a1ef992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e67c5d6-c3e1-4da4-b8bb-8e078db587b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e67c5d6-c3e1-4da4-b8bb-8e078db587b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1825382840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be9d65d-6c83-4b52-b489-46c1494bcbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf3a65b68c4f9f908d8dd135697038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:11Z,use_quota=True,user_id='3d2578b34f88485289c98ef3146a5ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2ecf6a-b5ec-4a15-9b9f-f0623b0b4f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2ecf6a-b5ec-4a15-9b9f-f0623b0b4f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0178af75-4c55-4dea-a1c7-6dde383ec7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0178af75-4c55-4dea-a1c7-6dde383ec7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be9d65d-6c83-4b52-b489-46c1494bcbad', 'volume_name': 'volume-1be9d65d-6c83-4b52-b489-46c1494bcbad', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b3bfa7-64ca-4a6d-b433-f27923c4399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b3bfa7-64ca-4a6d-b433-f27923c4399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41e72db-a8d6-47ce-9b13-3f56fc8d0d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Volume 1be9d65d-6c83-4b52-b489-46c1494bcbad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be9d65d-6c83-4b52-b489-46c1494bcbad', 'volume_size': 1}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1825382840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1be9d65d-6c83-4b52-b489-46c1494bcbad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf3a65b68c4f9f908d8dd135697038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:11Z,use_quota=True,user_id='3d2578b34f88485289c98ef3146a5ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Creating volume 1be9d65d-6c83-4b52-b489-46c1494bcbad {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:29:11 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:11 devstack sudo[102858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad 1073741824
Nov 05 04:29:11 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:11 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad 1073741824" returned: 0 in 0.484s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:11 devstack sudo[102865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad
Nov 05 04:29:11 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:11 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad" returned: 0 in 0.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41e72db-a8d6-47ce-9b13-3f56fc8d0d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be9d65d-6c83-4b52-b489-46c1494bcbad', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ce0e02-4317-4f59-a19b-0203b6478814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Volume volume-1be9d65d-6c83-4b52-b489-46c1494bcbad (1be9d65d-6c83-4b52-b489-46c1494bcbad): created successfully
Nov 05 04:29:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ce0e02-4317-4f59-a19b-0203b6478814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Flow 'volume_create_manager' (945626fd-e8f1-461d-8444-02f02a1ef992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-14dbaa7f-81c3-4468-84ec-893e286ee8d7 tempest-VolumesTransfersV357Test-1505279458 None] Created volume successfully.
Nov 05 04:29:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ea4f1f89-0180-4476-a261-2a4fac17358a tempest-VolumesTransfersV357Test-1133372726 None] Transfer volume completed successfully.
Nov 05 04:29:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Acquiring lock "cinder-1be9d65d-6c83-4b52-b489-46c1494bcbad-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Lock "cinder-1be9d65d-6c83-4b52-b489-46c1494bcbad-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Acquiring lock "cinder-quobyte-1be9d65d-6c83-4b52-b489-46c1494bcbad" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Lock "cinder-quobyte-1be9d65d-6c83-4b52-b489-46c1494bcbad" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac3b30c-77ea-425a-84d5-71ad811c128f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:14 devstack sudo[102875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad
Nov 05 04:29:14 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:14 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad" returned: 0 in 0.404s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:14 devstack sudo[102882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad
Nov 05 04:29:14 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:15 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-1be9d65d-6c83-4b52-b489-46c1494bcbad" returned: 0 in 0.295s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Lock "cinder-quobyte-1be9d65d-6c83-4b52-b489-46c1494bcbad" released by "delete_volume" :: held 0.746s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Created reservations ['ec85cdd7-a649-4c7a-bd62-8084e09ea8d4', '381d04cd-dbed-429e-995f-9212b24f642e', 'f1286e2b-4727-4de3-8691-5debd3b4edb9', 'c062d2a8-9295-4cee-a75f-cb47d212396b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:15 devstack sudo[102885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:29:15 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-c16f2440-9a9e-4b36-82fd-9129c041f043 req-6e288176-1d59-4804-8b2a-140e7dd35977 tempest-TestMinimumBasicScenario-1161422390 None] Terminate volume connection completed successfully.
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-c16f2440-9a9e-4b36-82fd-9129c041f043 req-6e288176-1d59-4804-8b2a-140e7dd35977 tempest-TestMinimumBasicScenario-1161422390 None] Deleting attachment 93408ff1-6cfa-4ce1-9033-78c1ee4516f7. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:29:15 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:29:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Deleted volume successfully.
Nov 05 04:29:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3c908cea-35d3-4ee0-86b4-53700f677616 tempest-VolumesTransfersV357Test-2139359636 None] Lock "cinder-1be9d65d-6c83-4b52-b489-46c1494bcbad-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Flow 'volume_create_manager' (595d3d61-e646-4717-be65-9fca59076588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6485a7d5-3bac-4308-b143-cb8588515ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6485a7d5-3bac-4308-b143-cb8588515ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1704495531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b335a51e-8639-4d73-bcdc-c77d6b2f8281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf3a65b68c4f9f908d8dd135697038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:16Z,use_quota=True,user_id='3d2578b34f88485289c98ef3146a5ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f2f148-f91f-45c5-a8b7-c86dd2bd4501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f2f148-f91f-45c5-a8b7-c86dd2bd4501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15759959-b728-4e1d-b22d-ac745dafef20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15759959-b728-4e1d-b22d-ac745dafef20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b335a51e-8639-4d73-bcdc-c77d6b2f8281', 'volume_name': 'volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82071141-c462-46d2-b2d1-af0c3f837a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82071141-c462-46d2-b2d1-af0c3f837a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bc36d5-5b89-4ad7-a07e-3dd89e75d781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Volume b335a51e-8639-4d73-bcdc-c77d6b2f8281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281', 'volume_size': 1}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1704495531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b335a51e-8639-4d73-bcdc-c77d6b2f8281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbf3a65b68c4f9f908d8dd135697038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:16Z,use_quota=True,user_id='3d2578b34f88485289c98ef3146a5ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Creating volume b335a51e-8639-4d73-bcdc-c77d6b2f8281 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:29:16 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:16 devstack sudo[102890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281 1073741824
Nov 05 04:29:16 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Acquiring lock "cinder-080d8794-6412-473d-b984-d78c589b4e91-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Lock "cinder-080d8794-6412-473d-b984-d78c589b4e91-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Acquiring lock "cinder-quobyte-080d8794-6412-473d-b984-d78c589b4e91" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Lock "cinder-quobyte-080d8794-6412-473d-b984-d78c589b4e91" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba4459d-0041-4349-a436-95409f9dd7b2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:16 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281 1073741824" returned: 0 in 0.488s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:16 devstack sudo[102896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91
Nov 05 04:29:16 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:16 devstack sudo[102897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281
Nov 05 04:29:16 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:17 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bc36d5-5b89-4ad7-a07e-3dd89e75d781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce696a0d-eb30-4595-a4a2-0a49d21d8348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:17 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Volume volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281 (b335a51e-8639-4d73-bcdc-c77d6b2f8281): created successfully
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce696a0d-eb30-4595-a4a2-0a49d21d8348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:17 devstack sudo[102904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Flow 'volume_create_manager' (595d3d61-e646-4717-be65-9fca59076588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:17 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1ffe6440-bec5-4b32-bdba-94f0279ff64a tempest-VolumesTransfersV357Test-1505279458 None] Created volume successfully.
Nov 05 04:29:17 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-080d8794-6412-473d-b984-d78c589b4e91" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Lock "cinder-quobyte-080d8794-6412-473d-b984-d78c589b4e91" released by "delete_volume" :: held 0.694s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Created reservations ['e6514789-71e8-4f6a-b88b-1c5d2e4754e3', '9f081eb2-0a07-4c8e-b950-c73fb0e19047', 'dd9ec225-5388-4070-9b97-9151aff812d3', 'd9b1fefa-e9fe-4099-8075-e65cc57ccfed'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:17 devstack sudo[102913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:29:17 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Acquiring lock "cinder-b335a51e-8639-4d73-bcdc-c77d6b2f8281-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Lock "cinder-b335a51e-8639-4d73-bcdc-c77d6b2f8281-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Acquiring lock "cinder-quobyte-b335a51e-8639-4d73-bcdc-c77d6b2f8281" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Lock "cinder-quobyte-b335a51e-8639-4d73-bcdc-c77d6b2f8281" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e63f4c4-ac49-4fad-9657-e72a757a364a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:17 devstack sudo[102915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281
Nov 05 04:29:17 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:17 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.280s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:29:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Deleted volume successfully.
Nov 05 04:29:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-29b4750c-e616-42c3-ba46-9caed7726d67 tempest-TestMinimumBasicScenario-1161422390 None] Lock "cinder-080d8794-6412-473d-b984-d78c589b4e91-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:17 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:18 devstack sudo[102922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281
Nov 05 04:29:18 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:18 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b335a51e-8639-4d73-bcdc-c77d6b2f8281" returned: 0 in 0.316s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Lock "cinder-quobyte-b335a51e-8639-4d73-bcdc-c77d6b2f8281" released by "delete_volume" :: held 0.781s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Created reservations ['47a1ec41-d93b-4e44-9bdb-665e0972bf97', 'e64601e6-0457-40e6-960b-9fa9eb2f50a4', '673ac087-6ac1-435a-9f65-206549ce22de', '3b565aad-49f4-4d92-bea8-7e684117b55a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:18 devstack sudo[102945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:29:18 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:18 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:29:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Deleted volume successfully.
Nov 05 04:29:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-44e7916c-ce05-4b3f-be67-3768292c9843 tempest-VolumesTransfersV357Test-2139359636 None] Lock "cinder-b335a51e-8639-4d73-bcdc-c77d6b2f8281-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-56360bba-177e-4b2c-8985-eef815dc6a77 tempest-TestShelveInstance-780228114 None] Terminate volume connection completed successfully.
Nov 05 04:29:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-56360bba-177e-4b2c-8985-eef815dc6a77 tempest-TestShelveInstance-780228114 None] Deleting attachment 16bee2b9-e4bd-4698-a3e3-6f2ddf33c43e. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:29:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Acquiring lock "cinder-995ab850-0488-4ae9-97e3-0ccc76563083-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Lock "cinder-995ab850-0488-4ae9-97e3-0ccc76563083-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Acquiring lock "cinder-quobyte-995ab850-0488-4ae9-97e3-0ccc76563083" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Lock "cinder-quobyte-995ab850-0488-4ae9-97e3-0ccc76563083" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a91cf82-b080-4673-9f2b-12d70dcc8c7b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:22 devstack sudo[102982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083
Nov 05 04:29:22 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:23 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083" returned: 0 in 0.545s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:23 devstack sudo[102988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083
Nov 05 04:29:23 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:23 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-995ab850-0488-4ae9-97e3-0ccc76563083" returned: 0 in 0.347s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Lock "cinder-quobyte-995ab850-0488-4ae9-97e3-0ccc76563083" released by "delete_volume" :: held 0.984s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG cinder.quota [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Created reservations ['3fb1ab1b-241f-4ce6-b08b-caf13b60f712', 'a2be5c78-9701-4817-822d-809a570b25c6', '10428ad9-bfc9-4af1-8975-7d3613776216', 'fd16a380-c9cb-46b9-af14-829040c0dfca'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:23 devstack sudo[102993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:29:23 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:24 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.341s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:24 devstack cinder-volume[87166]: DEBUG cinder.manager [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:29:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Deleted volume successfully.
Nov 05 04:29:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [req-13210d50-4623-45b0-be6f-f70cdbae8043 req-a5ce16ef-1a00-4e2d-8d2d-85da5f7598e0 tempest-TestShelveInstance-780228114 None] Lock "cinder-995ab850-0488-4ae9-97e3-0ccc76563083-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Flow 'volume_create_manager' (8c441aca-3345-4800-9f14-5b646dc6721d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331dc536-d829-4393-a582-33c062cb7e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331dc536-d829-4393-a582-33c062cb7e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-812541773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbae72a6-f7cf-4e87-b225-d9a83fc3505d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22f7d8243dca4959ad5cb48805983196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:27Z,use_quota=True,user_id='0fb0fa6d41734c27a671ccc1a16d75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31ca445-cb5d-4324-8c55-4ba0a00aded6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31ca445-cb5d-4324-8c55-4ba0a00aded6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd144ed-4401-4fd8-a9b3-35ce380be781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd144ed-4401-4fd8-a9b3-35ce380be781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbae72a6-f7cf-4e87-b225-d9a83fc3505d', 'volume_name': 'volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc61a55-8d15-42bd-af9e-8e5cdeee90be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc61a55-8d15-42bd-af9e-8e5cdeee90be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d8d4a7-69b3-41d8-95e4-46e47e53c6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:27 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Volume bbae72a6-f7cf-4e87-b225-d9a83fc3505d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d', 'volume_size': 1}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-812541773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbae72a6-f7cf-4e87-b225-d9a83fc3505d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22f7d8243dca4959ad5cb48805983196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:27Z,use_quota=True,user_id='0fb0fa6d41734c27a671ccc1a16d75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Creating volume bbae72a6-f7cf-4e87-b225-d9a83fc3505d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:29:27 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:29:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:27 devstack sudo[102998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d 1073741824
Nov 05 04:29:27 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:28 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d 1073741824" returned: 0 in 0.557s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:28 devstack sudo[103005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d
Nov 05 04:29:28 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:28 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d" returned: 0 in 0.292s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:29:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d8d4a7-69b3-41d8-95e4-46e47e53c6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c125c0-eecb-4f7e-b46d-89fa15e222c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Volume volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d (bbae72a6-f7cf-4e87-b225-d9a83fc3505d): created successfully
Nov 05 04:29:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7c125c0-eecb-4f7e-b46d-89fa15e222c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Flow 'volume_create_manager' (8c441aca-3345-4800-9f14-5b646dc6721d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f25ed162-4d7c-42b3-9cd5-d539936bcea1 tempest-VolumesListTestJSON-1041906467 None] Created volume successfully.
Nov 05 04:29:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:29:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:29:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Flow 'volume_create_manager' (a1f23125-d9b0-44dd-85c6-f71caeec6e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650752b5-a762-49c5-9cf5-7efca9da7c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (650752b5-a762-49c5-9cf5-7efca9da7c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-748881055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621c9e0d-d72f-445f-8ba8-f68f2811f036,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22f7d8243dca4959ad5cb48805983196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:30Z,use_quota=True,user_id='0fb0fa6d41734c27a671ccc1a16d75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cfc682-d16a-4436-a796-666d0ccaac6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4cfc682-d16a-4436-a796-666d0ccaac6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a790de1-d9cf-4b6d-bd70-cc36a3547e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a790de1-d9cf-4b6d-bd70-cc36a3547e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621c9e0d-d72f-445f-8ba8-f68f2811f036', 'volume_name': 'volume-621c9e0d-d72f-445f-8ba8-f68f2811f036', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d33acb-efab-4560-916a-e87e4d2ce7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61d33acb-efab-4560-916a-e87e4d2ce7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f38c87-0f2e-44d7-ae7d-ac40ac9cbc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:30 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Volume 621c9e0d-d72f-445f-8ba8-f68f2811f036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621c9e0d-d72f-445f-8ba8-f68f2811f036', 'volume_size': 1}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-748881055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621c9e0d-d72f-445f-8ba8-f68f2811f036,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22f7d8243dca4959ad5cb48805983196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:30Z,use_quota=True,user_id='0fb0fa6d41734c27a671ccc1a16d75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Creating volume 621c9e0d-d72f-445f-8ba8-f68f2811f036 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:29:30 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:30 devstack sudo[103009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036 1073741824
Nov 05 04:29:30 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:30 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036 1073741824" returned: 0 in 0.549s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:31 devstack sudo[103020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036
Nov 05 04:29:31 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:31 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:29:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f38c87-0f2e-44d7-ae7d-ac40ac9cbc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621c9e0d-d72f-445f-8ba8-f68f2811f036', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99bc036-f39e-46f7-bbb0-2e48c1e2ef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:31 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Volume volume-621c9e0d-d72f-445f-8ba8-f68f2811f036 (621c9e0d-d72f-445f-8ba8-f68f2811f036): created successfully
Nov 05 04:29:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99bc036-f39e-46f7-bbb0-2e48c1e2ef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Flow 'volume_create_manager' (a1f23125-d9b0-44dd-85c6-f71caeec6e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:31 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b5864531-9c94-40f2-8c4b-904c56d7ed2d tempest-VolumesListTestJSON-1041906467 None] Created volume successfully.
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Flow 'volume_create_manager' (9039f143-f617-4a69-8c1c-5fcc13db65e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd75560-f199-42b8-97fd-1eb1e8cbca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd75560-f199-42b8-97fd-1eb1e8cbca73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1497393400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b2756c-450f-4ca4-8516-a9b1d45a2b3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22f7d8243dca4959ad5cb48805983196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:33Z,use_quota=True,user_id='0fb0fa6d41734c27a671ccc1a16d75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a531133b-6190-4aa8-b3d0-0b4c2147ea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a531133b-6190-4aa8-b3d0-0b4c2147ea09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cd02ed-3fed-4431-a565-122c5104a5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6cd02ed-3fed-4431-a565-122c5104a5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4b2756c-450f-4ca4-8516-a9b1d45a2b3b', 'volume_name': 'volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7a21e5-c7ab-4506-8fdf-3d2796e01250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7a21e5-c7ab-4506-8fdf-3d2796e01250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0deb787-9ada-4be8-bca8-24537bf0440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Volume f4b2756c-450f-4ca4-8516-a9b1d45a2b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b', 'volume_size': 1}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1497393400',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4b2756c-450f-4ca4-8516-a9b1d45a2b3b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='22f7d8243dca4959ad5cb48805983196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:33Z,use_quota=True,user_id='0fb0fa6d41734c27a671ccc1a16d75c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Creating volume f4b2756c-450f-4ca4-8516-a9b1d45a2b3b {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:29:33 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:33 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b 1073741824
Nov 05 04:29:33 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:33 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b 1073741824" returned: 0 in 0.537s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:33 devstack sudo[103065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b
Nov 05 04:29:33 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:34 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b" returned: 0 in 0.266s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:29:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0deb787-9ada-4be8-bca8-24537bf0440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf81226-8fa6-424c-88ae-016d42444686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Volume volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b (f4b2756c-450f-4ca4-8516-a9b1d45a2b3b): created successfully
Nov 05 04:29:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bf81226-8fa6-424c-88ae-016d42444686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Flow 'volume_create_manager' (9039f143-f617-4a69-8c1c-5fcc13db65e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-887e1cbd-28dc-44c8-8cb1-9adbd097fbc9 tempest-VolumesListTestJSON-1041906467 None] Created volume successfully.
Nov 05 04:29:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "cinder-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "cinder-quobyte-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-quobyte-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41d5e97-1d27-4068-ab44-24e26108eae0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:37 devstack sudo[103071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b
Nov 05 04:29:37 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:38 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:38 devstack sudo[103076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b
Nov 05 04:29:38 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:38 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b" returned: 0 in 0.252s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-quobyte-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b" released by "delete_volume" :: held 0.736s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Created reservations ['b674d9b9-7654-4d6d-b397-c0339a01983e', '42d3124a-e8e9-4075-82ad-07d93c46a3a3', '291a85fe-eb9f-4255-b50a-ccece358e7cf', 'd77f0a0e-7f52-4525-b9b6-ed37c2148150'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:38 devstack sudo[103079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:29:38 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:38 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.420s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "cinder-621c9e0d-d72f-445f-8ba8-f68f2811f036-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Deleted volume successfully.
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-621c9e0d-d72f-445f-8ba8-f68f2811f036-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-abf479fe-a5d9-4e0a-98ad-b9bddf063c00 tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-f4b2756c-450f-4ca4-8516-a9b1d45a2b3b-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "cinder-quobyte-621c9e0d-d72f-445f-8ba8-f68f2811f036" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-quobyte-621c9e0d-d72f-445f-8ba8-f68f2811f036" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba50dee7-70a0-4e92-9e16-acebf580f0c8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:39 devstack sudo[103082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036
Nov 05 04:29:39 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:39 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036" returned: 0 in 0.463s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:39 devstack sudo[103087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036
Nov 05 04:29:39 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Flow 'volume_create_manager' (3dd68a45-7156-4f8d-98ae-c79d51ad7940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a501d7f-cf1b-4a9a-91b0-2ad475557800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:39 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-621c9e0d-d72f-445f-8ba8-f68f2811f036" returned: 0 in 0.302s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a501d7f-cf1b-4a9a-91b0-2ad475557800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-466088388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6608211e-ff2c-4d86-8216-8b4d291b0f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037db60508e746ac829df2974e8f89e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:40Z,use_quota=True,user_id='2a03f0de8c8c4c8cb5ab4868ca8ce0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b087df1-d8be-4fd2-a3d5-6f3ef5a071b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b087df1-d8be-4fd2-a3d5-6f3ef5a071b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732879dc-189d-47a6-9550-798e1f7e8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (732879dc-189d-47a6-9550-798e1f7e8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6608211e-ff2c-4d86-8216-8b4d291b0f07', 'volume_name': 'volume-6608211e-ff2c-4d86-8216-8b4d291b0f07', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f5aaf8-1ad6-4cd8-ac5f-da2569f4a1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f5aaf8-1ad6-4cd8-ac5f-da2569f4a1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee6a6d0-7e64-4d6a-8069-aa2e6f9602e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Volume 6608211e-ff2c-4d86-8216-8b4d291b0f07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6608211e-ff2c-4d86-8216-8b4d291b0f07', 'volume_size': 1}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-466088388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6608211e-ff2c-4d86-8216-8b4d291b0f07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037db60508e746ac829df2974e8f89e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:40Z,use_quota=True,user_id='2a03f0de8c8c4c8cb5ab4868ca8ce0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Creating volume 6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:29:39 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-quobyte-621c9e0d-d72f-445f-8ba8-f68f2811f036" released by "delete_volume" :: held 0.916s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:39 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 1073741824
Nov 05 04:29:39 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Created reservations ['17af0d71-df74-4a4a-88fb-b81e383465fe', '506143a8-6182-4020-8237-40e25fe5efc8', 'ee545ee0-8569-4726-a8ef-292e5c369670', '4b579f2b-30de-43aa-b4df-0b345c86ae22'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:40 devstack sudo[103093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:29:40 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "cinder-bbae72a6-f7cf-4e87-b225-d9a83fc3505d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-bbae72a6-f7cf-4e87-b225-d9a83fc3505d-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "cinder-quobyte-bbae72a6-f7cf-4e87-b225-d9a83fc3505d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-quobyte-bbae72a6-f7cf-4e87-b225-d9a83fc3505d" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:40 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.395s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e14add-64c0-4ed6-b858-4c1f6c3a36eb]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Deleted volume successfully.
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6a8db329-d832-48ee-82e0-fe3dba99c14f tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-621c9e0d-d72f-445f-8ba8-f68f2811f036-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:40 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 1073741824" returned: 0 in 0.718s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:40 devstack sudo[103100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d
Nov 05 04:29:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:40 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:40 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07
Nov 05 04:29:40 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:41 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:41 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d" returned: 0 in 0.520s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:41 devstack sudo[103109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d
Nov 05 04:29:41 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee6a6d0-7e64-4d6a-8069-aa2e6f9602e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6608211e-ff2c-4d86-8216-8b4d291b0f07', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c1ee75-7ead-41f2-b3f1-0588f183aab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Volume volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 (6608211e-ff2c-4d86-8216-8b4d291b0f07): created successfully
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c1ee75-7ead-41f2-b3f1-0588f183aab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Flow 'volume_create_manager' (3dd68a45-7156-4f8d-98ae-c79d51ad7940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-60c587f8-7eb2-4257-bb9d-fd0c02406021 tempest-VolumeDependencyTests-894985643 None] Created volume successfully.
Nov 05 04:29:41 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-bbae72a6-f7cf-4e87-b225-d9a83fc3505d" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-quobyte-bbae72a6-f7cf-4e87-b225-d9a83fc3505d" released by "delete_volume" :: held 0.864s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Created reservations ['ae0c028f-094c-4e3e-b47c-3de6ecccdce0', '8e5e69fc-3533-4d80-9756-5cf9ad826633', '43fcffe2-aee6-4fb9-84e2-dfea4d27514b', '8c9902c3-ae9f-4134-b0f6-061666e85779'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:41 devstack sudo[103112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:29:41 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:41 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:29:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Deleted volume successfully.
Nov 05 04:29:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-184d81f5-c3b2-403f-b80d-8078af950b91 tempest-VolumesListTestJSON-1041906467 None] Lock "cinder-bbae72a6-f7cf-4e87-b225-d9a83fc3505d-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Creating offline snapshot c8555067-8c9d-4575-a72f-494d5792ae0f of volume 6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:29:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91fdbf1-3ad5-44bf-8c1c-22c0e4f5edb8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:42 devstack sudo[103115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07
Nov 05 04:29:42 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:42 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:42 devstack sudo[103120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f 1G
Nov 05 04:29:42 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:43 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f 1G" returned: 0 in 0.478s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:43 devstack sudo[103125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f
Nov 05 04:29:43 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:43 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:43 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f is being set with open permissions: ugo+rw
Nov 05 04:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:43 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f
Nov 05 04:29:43 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:43 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:43 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.info
Nov 05 04:29:43 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:43 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.info" returned: 0 in 0.273s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:43 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.info is being set with open permissions: ugo+rw
Nov 05 04:29:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:43 devstack sudo[103136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.info
Nov 05 04:29:43 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:44 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.info" returned: 0 in 0.290s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0f393ed4-873c-4571-8138-c3e887fe88a5 tempest-VolumeDependencyTests-894985643 None] Create snapshot completed successfully
Nov 05 04:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:29:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Flow 'volume_create_manager' (6848f04f-9e49-4c13-989d-4078e4e8ade0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37914b0f-9dac-4500-9d2c-96894138b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37914b0f-9dac-4500-9d2c-96894138b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2032086319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a29b8f9-7665-484a-b86f-88d7e98483f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037db60508e746ac829df2974e8f89e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8555067-8c9d-4575-a72f-494d5792ae0f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:29:46Z,use_quota=True,user_id='2a03f0de8c8c4c8cb5ab4868ca8ce0d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a0947a-efd2-4a88-bbf7-334f9ca2b086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a0947a-efd2-4a88-bbf7-334f9ca2b086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71d2761-f985-4ede-b9da-9c7b71a95035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e71d2761-f985-4ede-b9da-9c7b71a95035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3a29b8f9-7665-484a-b86f-88d7e98483f2', 'volume_name': 'volume-3a29b8f9-7665-484a-b86f-88d7e98483f2', 'volume_size': 1, 'snapshot_id': 'c8555067-8c9d-4575-a72f-494d5792ae0f'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc2e27c-d4a7-4f07-ac9a-c011079614a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc2e27c-d4a7-4f07-ac9a-c011079614a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920c0d8b-2738-4aeb-928f-0a33a9a2f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:46 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Volume 3a29b8f9-7665-484a-b86f-88d7e98483f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3a29b8f9-7665-484a-b86f-88d7e98483f2', 'volume_size': 1, 'snapshot_id': 'c8555067-8c9d-4575-a72f-494d5792ae0f'}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Acquiring lock "cinder-quobyte-c8555067-8c9d-4575-a72f-494d5792ae0f-3a29b8f9-7665-484a-b86f-88d7e98483f2" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-c8555067-8c9d-4575-a72f-494d5792ae0f-3a29b8f9-7665-484a-b86f-88d7e98483f2" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Creating volume 3a29b8f9-7665-484a-b86f-88d7e98483f2 from snapshot c8555067-8c9d-4575-a72f-494d5792ae0f {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Acquiring lock "cinder-quobyte-3a29b8f9-7665-484a-b86f-88d7e98483f2" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-3a29b8f9-7665-484a-b86f-88d7e98483f2" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] snapshot: c8555067-8c9d-4575-a72f-494d5792ae0f, volume: 3a29b8f9-7665-484a-b86f-88d7e98483f2,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f2d778-1011-4b1a-af8c-8141a333a0f5]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:46 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f
Nov 05 04:29:46 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:46 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f" returned: 0 in 0.438s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6608211e-ff2c-4d86-8216-8b4d291b0f07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[26791bc2-ae19-4f92-a515-4ef2b493493a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:46 devstack sudo[103144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07
Nov 05 04:29:46 devstack sudo[103144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:47 devstack sudo[103144]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07" returned: 0 in 0.501s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:29:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:29:47 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:29:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:47 devstack sudo[103149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2
Nov 05 04:29:47 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:55 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2" returned: 0 in 8.325s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07, size 1024.00 MB, duration 8.33 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:29:55 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Converted 1024.00 MB image at 122.98 MB/s
Nov 05 04:29:55 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2 is being set with open permissions: ugo+rw
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:55 devstack sudo[103163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2
Nov 05 04:29:55 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:55 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-3a29b8f9-7665-484a-b86f-88d7e98483f2" released by "_copy_volume_from_snapshot" :: held 9.643s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-c8555067-8c9d-4575-a72f-494d5792ae0f-3a29b8f9-7665-484a-b86f-88d7e98483f2" released by "_create_volume_from_snapshot" :: held 9.736s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.761s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920c0d8b-2738-4aeb-928f-0a33a9a2f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a29b8f9-7665-484a-b86f-88d7e98483f2', 'volume_size': 1, 'snapshot_id': 'c8555067-8c9d-4575-a72f-494d5792ae0f'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cb845a-20fe-4075-a521-b9bfac56b063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:29:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Volume volume-3a29b8f9-7665-484a-b86f-88d7e98483f2 (3a29b8f9-7665-484a-b86f-88d7e98483f2): created successfully
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cb845a-20fe-4075-a521-b9bfac56b063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:29:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Flow 'volume_create_manager' (6848f04f-9e49-4c13-989d-4078e4e8ade0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:29:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fd6002c0-b690-4a95-83e1-5f5497c6de1a tempest-VolumeDependencyTests-894985643 None] Created volume successfully.
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Acquiring lock "cinder-c8555067-8c9d-4575-a72f-494d5792ae0f-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-c8555067-8c9d-4575-a72f-494d5792ae0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Acquiring lock "cinder-quobyte-6608211e-ff2c-4d86-8216-8b4d291b0f07" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-6608211e-ff2c-4d86-8216-8b4d291b0f07" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Acquiring lock "cinder-quobyte-c8555067-8c9d-4575-a72f-494d5792ae0f" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-c8555067-8c9d-4575-a72f-494d5792ae0f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Deleting offline snapshot c8555067-8c9d-4575-a72f-494d5792ae0f of volume 6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] snapshot_file for this snap is: volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23a099b-8265-408b-907e-27955bdca0bf]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:57 devstack sudo[103166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f
Nov 05 04:29:57 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:57 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f" returned: 0 in 0.414s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6608211e-ff2c-4d86-8216-8b4d291b0f07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a83c403-de0a-4102-a2e6-49e2f36c10d6]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:29:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:57 devstack sudo[103171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07
Nov 05 04:29:57 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:58 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07" returned: 0 in 0.670s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:58 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f
Nov 05 04:29:58 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:58 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:29:58 devstack sudo[103182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f
Nov 05 04:29:58 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:29:59 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root
Nov 05 04:29:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07.c8555067-8c9d-4575-a72f-494d5792ae0f" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:29:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-c8555067-8c9d-4575-a72f-494d5792ae0f" released by "_delete_snapshot" :: held 1.957s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-6608211e-ff2c-4d86-8216-8b4d291b0f07" released by "delete_snapshot" :: held 1.988s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:29:59 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Created reservations ['c5ebfea0-8dde-4318-b434-bfb4314b9408', 'd10e2079-4957-4b3e-9ebc-07b3dcd8db62', '18cbb4b2-8897-4699-b549-ac8c8b1c00b3', 'bddf4afa-cdad-4b10-8a01-5802e2d070f1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:29:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Delete snapshot completed successfully.
Nov 05 04:29:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ed36eeee-cb5e-493f-9792-43c5e858aee9 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-c8555067-8c9d-4575-a72f-494d5792ae0f-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Acquiring lock "cinder-6608211e-ff2c-4d86-8216-8b4d291b0f07-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Lock "cinder-6608211e-ff2c-4d86-8216-8b4d291b0f07-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Acquiring lock "cinder-quobyte-6608211e-ff2c-4d86-8216-8b4d291b0f07" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-6608211e-ff2c-4d86-8216-8b4d291b0f07" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edab72d-a679-4d1c-8bde-d6a9162cf148]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:00 devstack sudo[103186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07
Nov 05 04:30:00 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:00 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07" returned: 0 in 0.461s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:00 devstack sudo[103191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07
Nov 05 04:30:00 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:01 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6608211e-ff2c-4d86-8216-8b4d291b0f07" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-6608211e-ff2c-4d86-8216-8b4d291b0f07" released by "delete_volume" :: held 0.864s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Created reservations ['dae1bd89-9199-4ab8-b5f8-e613b97d6373', '8308521f-17b8-4945-8646-04ce2d482807', 'ddce8f32-e130-4000-b3c3-44bfd310ae61', '1ab8480c-afdc-4e91-bf39-8e0124a3223d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:01 devstack sudo[103194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:30:01 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Acquiring lock "cinder-3a29b8f9-7665-484a-b86f-88d7e98483f2-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-3a29b8f9-7665-484a-b86f-88d7e98483f2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Acquiring lock "cinder-quobyte-3a29b8f9-7665-484a-b86f-88d7e98483f2" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-3a29b8f9-7665-484a-b86f-88d7e98483f2" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3778d069-b55e-413b-a167-392ae3e0ba17]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:01 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.311s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:30:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Deleted volume successfully.
Nov 05 04:30:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-871e3ccc-85d6-4c70-9d5b-627c3f6dbe6c tempest-VolumeDependencyTests-894985643 None] Lock "cinder-6608211e-ff2c-4d86-8216-8b4d291b0f07-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:01 devstack sudo[103200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2
Nov 05 04:30:01 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:02 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:02 devstack sudo[103205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2
Nov 05 04:30:02 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:02 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3a29b8f9-7665-484a-b86f-88d7e98483f2" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-quobyte-3a29b8f9-7665-484a-b86f-88d7e98483f2" released by "delete_volume" :: held 0.768s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Created reservations ['bd998d78-d3d5-47d8-b308-d266e9c1eea1', '94686920-12a7-492b-89a9-5671394dc978', '4881bca6-421b-41b1-ab5a-d01e3ec8bec6', 'fc95f0c5-d9bc-43e5-b175-cef68918370d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:02 devstack sudo[103208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:30:02 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:03 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.326s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:03 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:30:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Deleted volume successfully.
Nov 05 04:30:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98a116fb-e166-4f42-9d59-4df39fbb2da2 tempest-VolumeDependencyTests-894985643 None] Lock "cinder-3a29b8f9-7665-484a-b86f-88d7e98483f2-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Flow 'volume_create_manager' (374ad68e-68f3-4b4c-8046-11fa57375bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c400b0f9-5cf9-4882-b21d-51a79f73e804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c400b0f9-5cf9-4882-b21d-51a79f73e804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-750968412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9435d41-d6d5-45d2-ade0-951915cbd668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b5bda8888d47c197d30976dcd1a007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:06Z,use_quota=True,user_id='39e1bf15e5d74a4fbe2b79641dd1f74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4840c322-8ebb-4edf-9fa7-86c2806cb51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4840c322-8ebb-4edf-9fa7-86c2806cb51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7715b4a6-bb23-41c7-b116-f16fa436acc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7715b4a6-bb23-41c7-b116-f16fa436acc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9435d41-d6d5-45d2-ade0-951915cbd668', 'volume_name': 'volume-e9435d41-d6d5-45d2-ade0-951915cbd668', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f13122-fa46-4998-9788-381579388103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f13122-fa46-4998-9788-381579388103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320bd10f-2b62-4bb7-8035-394f4cb97230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Volume e9435d41-d6d5-45d2-ade0-951915cbd668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9435d41-d6d5-45d2-ade0-951915cbd668', 'volume_size': 1}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-750968412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9435d41-d6d5-45d2-ade0-951915cbd668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b5bda8888d47c197d30976dcd1a007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:06Z,use_quota=True,user_id='39e1bf15e5d74a4fbe2b79641dd1f74a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Creating volume e9435d41-d6d5-45d2-ade0-951915cbd668 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:30:06 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:06 devstack sudo[103211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 1073741824
Nov 05 04:30:06 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:06 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 1073741824" returned: 0 in 0.609s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:07 devstack sudo[103218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668
Nov 05 04:30:07 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:30:07 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Flow 'volume_create_manager' (20eddc51-1b6c-425b-983c-0d81a78860f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0139cedd-8066-426f-9224-9614f61136d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668" returned: 0 in 0.387s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0139cedd-8066-426f-9224-9614f61136d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1642125423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27658f36-abcc-4e76-a04a-56a2a6ba6897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6d90e3855546518bf1c2afd968ff5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:07Z,use_quota=True,user_id='1d62a1fb9a1c4154bc9ff23761136e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1137292c-eade-4ecc-a6e4-c4b5930e70d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1137292c-eade-4ecc-a6e4-c4b5930e70d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1670cbe-d4eb-4a52-8273-bcd9695b5ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1670cbe-d4eb-4a52-8273-bcd9695b5ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27658f36-abcc-4e76-a04a-56a2a6ba6897', 'volume_name': 'volume-27658f36-abcc-4e76-a04a-56a2a6ba6897', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa04ec13-54e5-44e4-9f8a-194148fb4356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa04ec13-54e5-44e4-9f8a-194148fb4356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ecd8ea-59b5-438b-8049-f7694cd97494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:07 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Volume 27658f36-abcc-4e76-a04a-56a2a6ba6897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27658f36-abcc-4e76-a04a-56a2a6ba6897', 'volume_size': 1}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1642125423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27658f36-abcc-4e76-a04a-56a2a6ba6897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6d90e3855546518bf1c2afd968ff5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:07Z,use_quota=True,user_id='1d62a1fb9a1c4154bc9ff23761136e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Creating volume 27658f36-abcc-4e76-a04a-56a2a6ba6897 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:30:07 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320bd10f-2b62-4bb7-8035-394f4cb97230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9435d41-d6d5-45d2-ade0-951915cbd668', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450adfe6-349f-456f-94e9-f0c47376cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:07 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Volume volume-e9435d41-d6d5-45d2-ade0-951915cbd668 (e9435d41-d6d5-45d2-ade0-951915cbd668): created successfully
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450adfe6-349f-456f-94e9-f0c47376cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:07 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Flow 'volume_create_manager' (374ad68e-68f3-4b4c-8046-11fa57375bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:07 devstack sudo[103221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897 1073741824
Nov 05 04:30:07 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0f8dc43b-9d6b-4152-996d-b3c569833eda tempest-TestImageHashVerification-815657512 None] Created volume successfully.
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Flow 'volume_create_manager' (2634df13-c46e-4ae6-8f9a-ce8ff98a8d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40829580-dd09-4e4f-9b52-812f2b91f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40829580-dd09-4e4f-9b52-812f2b91f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-938767245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b007972d-19e4-4632-a558-bea0daf3bb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6d90e3855546518bf1c2afd968ff5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:08Z,use_quota=True,user_id='1d62a1fb9a1c4154bc9ff23761136e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc127cb1-821c-4e22-93c0-eb024a0d65a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc127cb1-821c-4e22-93c0-eb024a0d65a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9baf8818-c186-41a5-bce3-228c0f331e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9baf8818-c186-41a5-bce3-228c0f331e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b007972d-19e4-4632-a558-bea0daf3bb0c', 'volume_name': 'volume-b007972d-19e4-4632-a558-bea0daf3bb0c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17523d1f-ffa7-4354-8722-6224903e20a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17523d1f-ffa7-4354-8722-6224903e20a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc41388-bcfa-4ca2-93b1-ed215f5ebf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Volume b007972d-19e4-4632-a558-bea0daf3bb0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b007972d-19e4-4632-a558-bea0daf3bb0c', 'volume_size': 1}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:08 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897 1073741824" returned: 0 in 0.741s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:08 devstack sudo[103226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897
Nov 05 04:30:08 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:08 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-938767245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b007972d-19e4-4632-a558-bea0daf3bb0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6d90e3855546518bf1c2afd968ff5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:08Z,use_quota=True,user_id='1d62a1fb9a1c4154bc9ff23761136e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Creating volume b007972d-19e4-4632-a558-bea0daf3bb0c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:30:08 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:08 devstack sudo[103229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c 1073741824
Nov 05 04:30:08 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ecd8ea-59b5-438b-8049-f7694cd97494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27658f36-abcc-4e76-a04a-56a2a6ba6897', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6caa0d1-a575-4bc7-9dc9-e440312f08fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Volume volume-27658f36-abcc-4e76-a04a-56a2a6ba6897 (27658f36-abcc-4e76-a04a-56a2a6ba6897): created successfully
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6caa0d1-a575-4bc7-9dc9-e440312f08fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Flow 'volume_create_manager' (20eddc51-1b6c-425b-983c-0d81a78860f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6c1f950e-191d-44a1-958b-e1b22633df39 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Created volume successfully.
Nov 05 04:30:09 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c 1073741824" returned: 0 in 0.592s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Flow 'volume_create_manager' (f7f64054-aa67-46b0-98a5-98599f3da10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e83143-7a06-4406-b619-a4cfab0d762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e83143-7a06-4406-b619-a4cfab0d762c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba01281-50d7-4130-bc33-590511912f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6ce4e68f943cc96ead7887ad09ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:09Z,use_quota=True,user_id='a952ae6862e643589e2340fad84b942e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7614ea46-5036-4cb1-8f3e-a2f3a8fbda4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7614ea46-5036-4cb1-8f3e-a2f3a8fbda4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:09 devstack sudo[103235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c
Nov 05 04:30:09 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d501b55-1fb4-4235-853e-15be6c4aeabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d501b55-1fb4-4235-853e-15be6c4aeabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba01281-50d7-4130-bc33-590511912f7d', 'volume_name': 'volume-5ba01281-50d7-4130-bc33-590511912f7d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa1b748-0362-4b3e-95a4-7fe0069109ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa1b748-0362-4b3e-95a4-7fe0069109ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34516ac-3194-47ad-bf8d-5cfb8ae3d0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Volume 5ba01281-50d7-4130-bc33-590511912f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba01281-50d7-4130-bc33-590511912f7d', 'volume_size': 1}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:09 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c" returned: 0 in 0.313s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.253s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba01281-50d7-4130-bc33-590511912f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6ce4e68f943cc96ead7887ad09ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:09Z,use_quota=True,user_id='a952ae6862e643589e2340fad84b942e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Creating volume 5ba01281-50d7-4130-bc33-590511912f7d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:30:09 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:09 devstack sudo[103238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d 1073741824
Nov 05 04:30:09 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc41388-bcfa-4ca2-93b1-ed215f5ebf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b007972d-19e4-4632-a558-bea0daf3bb0c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a06767d-c534-4b15-91c7-3aa10c0c217f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:09 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Volume volume-b007972d-19e4-4632-a558-bea0daf3bb0c (b007972d-19e4-4632-a558-bea0daf3bb0c): created successfully
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a06767d-c534-4b15-91c7-3aa10c0c217f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:09 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Flow 'volume_create_manager' (2634df13-c46e-4ae6-8f9a-ce8ff98a8d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-eb5cff19-10a6-4852-b9a6-f212438ca800 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Created volume successfully.
Nov 05 04:30:10 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d 1073741824" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:10 devstack sudo[103245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d
Nov 05 04:30:10 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:10 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.761s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34516ac-3194-47ad-bf8d-5cfb8ae3d0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba01281-50d7-4130-bc33-590511912f7d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a755c4e-67b3-447d-aa08-5226da309f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe171c0-d822-41d1-95be-e14532c061ef]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Volume volume-5ba01281-50d7-4130-bc33-590511912f7d (5ba01281-50d7-4130-bc33-590511912f7d): created successfully
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a755c4e-67b3-447d-aa08-5226da309f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Flow 'volume_create_manager' (f7f64054-aa67-46b0-98a5-98599f3da10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b8cbc5f8-bf22-47e4-9b54-3bbb9401be3f tempest-CinderUnicodeTest-284802129 None] Created volume successfully.
Nov 05 04:30:10 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668
Nov 05 04:30:10 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:10 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ddb1f-1631-4a4c-b679-881fef58ee55]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:11 devstack sudo[103253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668
Nov 05 04:30:11 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:11 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668" returned: 0 in 0.454s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 /opt/stack/data/cinder/conversion/e9435d41-d6d5-45d2-ade0-951915cbd668.temp_image.e62121ec-5196-42c3-8140-e6ac69d72afbrajvnprf.img {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:11 devstack sudo[103259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 /opt/stack/data/cinder/conversion/e9435d41-d6d5-45d2-ade0-951915cbd668.temp_image.e62121ec-5196-42c3-8140-e6ac69d72afbrajvnprf.img
Nov 05 04:30:11 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=81,cinder:UPDATE=104,cinder:INSERT=27,cinder:DELETE=12 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:INSERT=25,cinder:UPDATE=120,cinder:DELETE=9,cinder:SELECT=80 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Flow 'volume_create_manager' (8acb5300-93b7-4b4c-9185-9d2835c34016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600a5c9c-cff5-46af-bdb5-1a3ad56ca4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (600a5c9c-cff5-46af-bdb5-1a3ad56ca4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-675318046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6ce4e68f943cc96ead7887ad09ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:12Z,use_quota=True,user_id='a952ae6862e643589e2340fad84b942e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b209f06f-cdb1-4222-b1ad-39803d4e3648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b209f06f-cdb1-4222-b1ad-39803d4e3648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b390c7-f4e4-465f-8b29-ff09c6e5ed43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32b390c7-f4e4-465f-8b29-ff09c6e5ed43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5', 'volume_name': 'volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ceac578-8b5f-4f56-b314-403825a71364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ceac578-8b5f-4f56-b314-403825a71364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51df792-126f-4db0-9352-e4b813b8e7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Volume 6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5', 'volume_size': 1}
Nov 05 04:30:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:19 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 /opt/stack/data/cinder/conversion/e9435d41-d6d5-45d2-ade0-951915cbd668.temp_image.e62121ec-5196-42c3-8140-e6ac69d72afbrajvnprf.img" returned: 0 in 7.685s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[267bb06e-357b-4074-b721-19e352d98522]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:19 devstack sudo[103299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668
Nov 05 04:30:19 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:19 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668" returned: 0 in 0.578s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:19 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668, size 1024.00 MB, duration 7.69 sec, destination /opt/stack/data/cinder/conversion/e9435d41-d6d5-45d2-ade0-951915cbd668.temp_image.e62121ec-5196-42c3-8140-e6ac69d72afbrajvnprf.img {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:30:19 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Converted 1024.00 MB image at 133.23 MB/s
Nov 05 04:30:19 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] e62121ec-5196-42c3-8140-e6ac69d72afb was raw, no need to convert to raw {{(pid=87166) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:29 devstack sudo[103386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:30:29 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:29 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.382s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:30:29 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.530s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Uploaded volume to glance image-id: e62121ec-5196-42c3-8140-e6ac69d72afb. {{(pid=87166) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.612s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:30:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-675318046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd6ce4e68f943cc96ead7887ad09ce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:30:12Z,use_quota=True,user_id='a952ae6862e643589e2340fad84b942e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Creating volume 6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:30:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:30:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:41 devstack sudo[103474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 1073741824
Nov 05 04:30:41 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3c3bc79e-5709-4f23-810c-04c84dd0ea8d tempest-TestImageHashVerification-815657512 None] Copy volume to image completed successfully.
Nov 05 04:30:41 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 1073741824" returned: 0 in 0.456s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:41 devstack sudo[103480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5
Nov 05 04:30:41 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:41 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Acquiring lock "cinder-e9435d41-d6d5-45d2-ade0-951915cbd668-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51df792-126f-4db0-9352-e4b813b8e7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bbbee3-289f-4dd3-a3fa-42a2199e1e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Lock "cinder-e9435d41-d6d5-45d2-ade0-951915cbd668-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Volume volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 (6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5): created successfully
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bbbee3-289f-4dd3-a3fa-42a2199e1e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Flow 'volume_create_manager' (8acb5300-93b7-4b4c-9185-9d2835c34016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:30:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5a32674a-6d4d-4d9b-902f-29bc74ee4a6f tempest-CinderUnicodeTest-284802129 None] Created volume successfully.
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Acquiring lock "cinder-quobyte-e9435d41-d6d5-45d2-ade0-951915cbd668" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Lock "cinder-quobyte-e9435d41-d6d5-45d2-ade0-951915cbd668" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b31b59-88fb-4e47-8588-d147ece01749]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:42 devstack sudo[103483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668
Nov 05 04:30:42 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:42 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668" returned: 0 in 0.373s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:42 devstack sudo[103488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668
Nov 05 04:30:42 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:42 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e9435d41-d6d5-45d2-ade0-951915cbd668" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Lock "cinder-quobyte-e9435d41-d6d5-45d2-ade0-951915cbd668" released by "delete_volume" :: held 0.688s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Created reservations ['ebbf9554-8ce4-400c-9f81-ea6da539a239', '7b483c70-9531-4881-8322-f06999f85ddf', '9df00a9d-f837-4c3d-b49b-9fddc96a5530', '12ef9e41-63d2-4e56-a968-3e7d594e471b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:42 devstack sudo[103491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:30:42 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Creating offline snapshot fef7e8b8-d711-4199-b72c-c4b748e3529e of volume 6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:30:43 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58cac38-05a6-4a0a-acd4-aeaf7f56da12]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Deleted volume successfully.
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-95ce4446-03be-46f0-bc32-28164c2a35db tempest-TestImageHashVerification-815657512 None] Lock "cinder-e9435d41-d6d5-45d2-ade0-951915cbd668-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:43 devstack sudo[103494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5
Nov 05 04:30:43 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:43 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" returned: 0 in 0.432s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:43 devstack sudo[103499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e 1G
Nov 05 04:30:43 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:44 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e 1G" returned: 0 in 0.511s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:44 devstack sudo[103505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e
Nov 05 04:30:44 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:44 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e" returned: 0 in 0.316s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:44 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e is being set with open permissions: ugo+rw
Nov 05 04:30:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:44 devstack sudo[103510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e
Nov 05 04:30:44 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:44 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:44 devstack sudo[103514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.info
Nov 05 04:30:44 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:44 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.info" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:44 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.info is being set with open permissions: ugo+rw
Nov 05 04:30:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:44 devstack sudo[103517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.info
Nov 05 04:30:44 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:45 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.info" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3fbd4446-8e81-40d4-9a81-37b305a0a84e tempest-CinderUnicodeTest-284802129 None] Create snapshot completed successfully
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Acquiring lock "cinder-fef7e8b8-d711-4199-b72c-c4b748e3529e-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Lock "cinder-fef7e8b8-d711-4199-b72c-c4b748e3529e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Acquiring lock "cinder-quobyte-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Lock "cinder-quobyte-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Acquiring lock "cinder-quobyte-fef7e8b8-d711-4199-b72c-c4b748e3529e" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Lock "cinder-quobyte-fef7e8b8-d711-4199-b72c-c4b748e3529e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Deleting offline snapshot fef7e8b8-d711-4199-b72c-c4b748e3529e of volume 6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] snapshot_file for this snap is: volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45c1429-3fab-4bf2-b27a-2e7f8a3755a0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:46 devstack sudo[103526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e
Nov 05 04:30:46 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:46 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e" returned: 0 in 0.518s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09ee27f-2736-4686-b0ee-43d613ae8b9b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-181038ed-7e76-4b23-bb52-bcff45fa12e9 req-316b9d81-ef96-4691-aaed-0a842e629f47 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-181038ed-7e76-4b23-bb52-bcff45fa12e9 req-316b9d81-ef96-4691-aaed-0a842e629f47 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-181038ed-7e76-4b23-bb52-bcff45fa12e9 req-316b9d81-ef96-4691-aaed-0a842e629f47 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-181038ed-7e76-4b23-bb52-bcff45fa12e9 req-316b9d81-ef96-4691-aaed-0a842e629f47 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-27658f36-abcc-4e76-a04a-56a2a6ba6897', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00c4069c-1197-400e-a4b8-c2aa7ee718ac', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:30:46 devstack sudo[103539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5
Nov 05 04:30:46 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-181038ed-7e76-4b23-bb52-bcff45fa12e9 req-316b9d81-ef96-4691-aaed-0a842e629f47 tempest-TestServerVolumeAttachmentScenario-1733625851 None] attachment_update completed successfully.
Nov 05 04:30:47 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" returned: 0 in 0.466s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:47 devstack sudo[103642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e
Nov 05 04:30:47 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:47 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e" returned: 0 in 0.513s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:47 devstack sudo[103967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e
Nov 05 04:30:47 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:48 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5.fef7e8b8-d711-4199-b72c-c4b748e3529e" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Lock "cinder-quobyte-fef7e8b8-d711-4199-b72c-c4b748e3529e" released by "_delete_snapshot" :: held 1.934s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Lock "cinder-quobyte-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" released by "delete_snapshot" :: held 1.959s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Created reservations ['aafb3354-574a-47c4-9f1e-a7e802a52cfe', '3f330d6f-f2ea-4eb4-ad92-0f4d20768e72', '6378ef87-da9c-469a-9947-0b4be050c466', '7eb72bd9-a55d-4a0c-baac-dd771de42213'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:30:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Delete snapshot completed successfully.
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-56022989-18ce-43e0-9187-9bee64ecb93a tempest-CinderUnicodeTest-284802129 None] Lock "cinder-fef7e8b8-d711-4199-b72c-c4b748e3529e-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Acquiring lock "cinder-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Lock "cinder-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Acquiring lock "cinder-quobyte-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Lock "cinder-quobyte-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7edfff-d2dd-44f5-bc88-abc001909203]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:48 devstack sudo[103970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5
Nov 05 04:30:48 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:48 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" returned: 0 in 0.436s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:48 devstack sudo[103975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5
Nov 05 04:30:48 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:49 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Lock "cinder-quobyte-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5" released by "delete_volume" :: held 0.782s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Created reservations ['d7327987-1788-4113-835c-aad35423c931', 'fa636015-2668-4a4d-a207-953af98062c1', 'be880e77-51b3-4cf6-b283-82de55e61dc2', 'dc257dbc-5233-4728-92aa-8f25d378a5f6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:49 devstack sudo[103979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:30:49 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Acquiring lock "cinder-5ba01281-50d7-4130-bc33-590511912f7d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Lock "cinder-5ba01281-50d7-4130-bc33-590511912f7d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:49 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.319s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Acquiring lock "cinder-quobyte-5ba01281-50d7-4130-bc33-590511912f7d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:30:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Deleted volume successfully.
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-479336fe-210e-4b37-86b2-0bd57f191015 tempest-CinderUnicodeTest-284802129 None] Lock "cinder-6018d5bb-abf4-4f8f-9968-0a0ccb8e78a5-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Lock "cinder-quobyte-5ba01281-50d7-4130-bc33-590511912f7d" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb56467d-03ba-438c-acb1-557de7710e37]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:30:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:49 devstack sudo[103983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d
Nov 05 04:30:49 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:50 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:50 devstack sudo[103988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d
Nov 05 04:30:50 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:50 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5ba01281-50d7-4130-bc33-590511912f7d" returned: 0 in 0.283s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Lock "cinder-quobyte-5ba01281-50d7-4130-bc33-590511912f7d" released by "delete_volume" :: held 0.770s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Created reservations ['77c6eb77-df69-4f4a-8ba6-b8fe5f8df854', '0682c180-3486-42b9-a0fe-79873c39876f', 'b96f0998-890c-4c43-b8da-c1d4042ccb04', 'c5a95ed7-ed03-4305-b804-ea9ec046f8ad'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:30:50 devstack sudo[103991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:30:50 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:30:50 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:30:50 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:30:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Deleted volume successfully.
Nov 05 04:30:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a24fa0d1-6602-4d8c-ab2a-bbc031bf6f05 tempest-CinderUnicodeTest-284802129 None] Lock "cinder-5ba01281-50d7-4130-bc33-590511912f7d-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-5ec915e9-1587-4884-86be-74ae45e2387c req-0b6a8de9-3b44-460f-80d1-a29315134490 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-5ec915e9-1587-4884-86be-74ae45e2387c req-0b6a8de9-3b44-460f-80d1-a29315134490 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:30:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-5ec915e9-1587-4884-86be-74ae45e2387c req-0b6a8de9-3b44-460f-80d1-a29315134490 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:30:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-5ec915e9-1587-4884-86be-74ae45e2387c req-0b6a8de9-3b44-460f-80d1-a29315134490 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-b007972d-19e4-4632-a558-bea0daf3bb0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e010bf6-63bb-443e-b104-6d8376bc7828', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:30:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-5ec915e9-1587-4884-86be-74ae45e2387c req-0b6a8de9-3b44-460f-80d1-a29315134490 tempest-TestServerVolumeAttachmentScenario-1733625851 None] attachment_update completed successfully.
Nov 05 04:30:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-01411516-f912-47d4-a4e4-1e9d3a8b13d0 req-63fa32ef-5b17-49dd-bace-6d9cb39e483f tempest-TestServerVolumeAttachmentScenario-1733625851 None] Terminate volume connection completed successfully.
Nov 05 04:30:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-01411516-f912-47d4-a4e4-1e9d3a8b13d0 req-63fa32ef-5b17-49dd-bace-6d9cb39e483f tempest-TestServerVolumeAttachmentScenario-1733625851 None] Deleting attachment 0e010bf6-63bb-443e-b104-6d8376bc7828. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:30:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-d3fb32ce-d5a9-43d9-9cf9-391d30af3f79 req-1125cdf6-50b1-4a76-861b-67d0c3f6bcbb tempest-TestServerVolumeAttachmentScenario-1733625851 None] Terminate volume connection completed successfully.
Nov 05 04:30:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-d3fb32ce-d5a9-43d9-9cf9-391d30af3f79 req-1125cdf6-50b1-4a76-861b-67d0c3f6bcbb tempest-TestServerVolumeAttachmentScenario-1733625851 None] Deleting attachment 00c4069c-1197-400e-a4b8-c2aa7ee718ac. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:31:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "cinder-b007972d-19e4-4632-a558-bea0daf3bb0c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "cinder-b007972d-19e4-4632-a558-bea0daf3bb0c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "cinder-quobyte-b007972d-19e4-4632-a558-bea0daf3bb0c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "cinder-quobyte-b007972d-19e4-4632-a558-bea0daf3bb0c" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa654a8f-d891-4874-9942-11ae4b9cb10d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:02 devstack sudo[104063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c
Nov 05 04:31:02 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:02 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c" returned: 0 in 0.489s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:02 devstack sudo[104068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c
Nov 05 04:31:02 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:02 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b007972d-19e4-4632-a558-bea0daf3bb0c" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "cinder-quobyte-b007972d-19e4-4632-a558-bea0daf3bb0c" released by "delete_volume" :: held 0.830s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Created reservations ['b9c3a7d4-9ff0-48e5-8b5f-817b7c6cee99', 'ef739f0b-01fa-461e-aaff-f5b246a3d5ac', '49bb2521-e562-4a16-9af9-c51584817389', '50e43fd3-6eaa-4f9b-be3a-f553a713877f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:03 devstack sudo[104071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:31:03 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "cinder-27658f36-abcc-4e76-a04a-56a2a6ba6897-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "cinder-27658f36-abcc-4e76-a04a-56a2a6ba6897-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "cinder-quobyte-27658f36-abcc-4e76-a04a-56a2a6ba6897" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "cinder-quobyte-27658f36-abcc-4e76-a04a-56a2a6ba6897" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[095abac2-0633-4100-a730-ebe51700d252]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:03 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.322s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:31:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Deleted volume successfully.
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d44e8bc5-5c0a-4d68-9e5f-6ef2409fe687 tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "cinder-b007972d-19e4-4632-a558-bea0daf3bb0c-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:03 devstack sudo[104074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897
Nov 05 04:31:03 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:03 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897" returned: 0 in 0.439s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:03 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897
Nov 05 04:31:03 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:04 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-27658f36-abcc-4e76-a04a-56a2a6ba6897" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "cinder-quobyte-27658f36-abcc-4e76-a04a-56a2a6ba6897" released by "delete_volume" :: held 0.825s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Created reservations ['fe6ebf42-bacf-405f-93c8-c57adc8e45e5', '6e728d8a-1163-4b2a-a28b-f33c30083b39', '05ae319b-b13a-4e63-859f-540da46f126a', '67db9579-13b8-4d62-bef6-08a94d33a542'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:04 devstack sudo[104082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:31:04 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:04 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:31:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Deleted volume successfully.
Nov 05 04:31:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9a2d3387-7898-48a5-80cd-68fe0a5785bd tempest-TestServerVolumeAttachmentScenario-1733625851 None] Lock "cinder-27658f36-abcc-4e76-a04a-56a2a6ba6897-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:14 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=60,cinder:SELECT=52,cinder:DELETE=4,cinder:INSERT=14 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:31:14 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=49,cinder:INSERT=12,cinder:UPDATE=46,cinder:DELETE=3 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:29 devstack sudo[104102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:31:29 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:29 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:31:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Flow 'volume_create_manager' (a4cc19f3-453d-4b8e-8a73-526fc7796e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b1b2b1-a456-401c-b0e8-bfbd03fac1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b1b2b1-a456-401c-b0e8-bfbd03fac1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1259162756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f65dd43-dea8-4950-be2b-3648410b5809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b255b34440d84e288d5d68ee6f1b43b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:31:32Z,use_quota=True,user_id='ddb60b95095d4a78a6edb50659cd096a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddab594-1dfe-4d28-a7d7-ae43e7bda8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddab594-1dfe-4d28-a7d7-ae43e7bda8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acb81cf-fe48-440e-8be4-0f948d6cf221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4acb81cf-fe48-440e-8be4-0f948d6cf221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f65dd43-dea8-4950-be2b-3648410b5809', 'volume_name': 'volume-4f65dd43-dea8-4950-be2b-3648410b5809', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94011b7-01c8-4670-9057-dffbe42302b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e94011b7-01c8-4670-9057-dffbe42302b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d330a54-64f7-41f8-bd15-55015f936acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:31 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Volume 4f65dd43-dea8-4950-be2b-3648410b5809: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f65dd43-dea8-4950-be2b-3648410b5809', 'volume_size': 1}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1259162756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f65dd43-dea8-4950-be2b-3648410b5809,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b255b34440d84e288d5d68ee6f1b43b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:31:32Z,use_quota=True,user_id='ddb60b95095d4a78a6edb50659cd096a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Creating volume 4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:31:31 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:31:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:31 devstack sudo[104106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 1073741824
Nov 05 04:31:31 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:32 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 1073741824" returned: 0 in 0.532s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:32 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809
Nov 05 04:31:32 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:32 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:31:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d330a54-64f7-41f8-bd15-55015f936acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f65dd43-dea8-4950-be2b-3648410b5809', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cb563a-1639-4658-b777-9b992fba620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:32 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Volume volume-4f65dd43-dea8-4950-be2b-3648410b5809 (4f65dd43-dea8-4950-be2b-3648410b5809): created successfully
Nov 05 04:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90cb563a-1639-4658-b777-9b992fba620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Flow 'volume_create_manager' (a4cc19f3-453d-4b8e-8a73-526fc7796e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:31:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a4f1de70-0bfb-473b-aebd-1c7991fd8af1 tempest-SnapshotDependencyTests-890825908 None] Created volume successfully.
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Flow 'volume_create_manager' (1c99e155-05f3-40e7-9d33-a8c3cf619d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730293d5-b697-426b-8f2c-ed81e0dee4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (730293d5-b697-426b-8f2c-ed81e0dee4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1743986548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8268ac54-1ad8-4830-805b-cdc78ee9e8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f5e36f618943949a241555f061b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:31:34Z,use_quota=True,user_id='162b0f07dd8147178bf2616bd46597ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caad4a4-ad68-4c70-b066-9d2dac936da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1caad4a4-ad68-4c70-b066-9d2dac936da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64c2e8b-fb05-4519-92ce-8bb31d55a072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64c2e8b-fb05-4519-92ce-8bb31d55a072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8268ac54-1ad8-4830-805b-cdc78ee9e8f9', 'volume_name': 'volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd011b45-e3a7-4164-9d3c-e1e8488769fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd011b45-e3a7-4164-9d3c-e1e8488769fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2deaf3e4-2886-4a6e-ae95-4b859798226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:33 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Volume 8268ac54-1ad8-4830-805b-cdc78ee9e8f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9', 'volume_size': 1}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1743986548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8268ac54-1ad8-4830-805b-cdc78ee9e8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f5e36f618943949a241555f061b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:31:34Z,use_quota=True,user_id='162b0f07dd8147178bf2616bd46597ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Creating volume 8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:31:33 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:33 devstack sudo[104114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 1073741824
Nov 05 04:31:33 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:34 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 1073741824" returned: 0 in 0.545s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:34 devstack sudo[104156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9
Nov 05 04:31:34 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:34 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.587s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Creating offline snapshot 164fc993-fd7d-4605-81e6-a800719efd7e of volume 4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2deaf3e4-2886-4a6e-ae95-4b859798226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794d900f-8bf1-4d27-8105-b1dcfc5badc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19c4a7-b532-43ff-b084-092fb24dd6b8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Volume volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 (8268ac54-1ad8-4830-805b-cdc78ee9e8f9): created successfully
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794d900f-8bf1-4d27-8105-b1dcfc5badc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Flow 'volume_create_manager' (1c99e155-05f3-40e7-9d33-a8c3cf619d64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:31:34 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a9eb20d0-5ab8-4186-8ec7-71c7362f239a tempest-TestStampPattern-1946862965 None] Created volume successfully.
Nov 05 04:31:34 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809
Nov 05 04:31:34 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:35 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809" returned: 0 in 0.409s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:35 devstack sudo[104167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e 1G
Nov 05 04:31:35 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:35 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e 1G" returned: 0 in 0.472s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f65dd43-dea8-4950-be2b-3648410b5809 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:35 devstack sudo[104172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f65dd43-dea8-4950-be2b-3648410b5809 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e
Nov 05 04:31:35 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:35 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f65dd43-dea8-4950-be2b-3648410b5809 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e" returned: 0 in 0.334s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:35 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e is being set with open permissions: ugo+rw
Nov 05 04:31:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:35 devstack sudo[104177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e
Nov 05 04:31:35 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:36 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:36 devstack sudo[104180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.info
Nov 05 04:31:36 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:36 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.info" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:36 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.info is being set with open permissions: ugo+rw
Nov 05 04:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:36 devstack sudo[104186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.info
Nov 05 04:31:36 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:36 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.info" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9b8bd18c-bd70-4bab-9435-5a644cc1f334 tempest-SnapshotDependencyTests-890825908 None] Create snapshot completed successfully
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Flow 'volume_create_manager' (17a4f0a6-5d22-4276-ace7-d3df3e794a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42d9308-6382-441c-85e4-fe07de8badb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a42d9308-6382-441c-85e4-fe07de8badb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=707951ae-f982-43df-9a3a-62f3bce41ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b255b34440d84e288d5d68ee6f1b43b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=164fc993-fd7d-4605-81e6-a800719efd7e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:31:38Z,use_quota=True,user_id='ddb60b95095d4a78a6edb50659cd096a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93deda73-7e6b-4d81-8512-06cfdf87364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93deda73-7e6b-4d81-8512-06cfdf87364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5525ed5b-bbb5-405a-90d1-5fad847b5729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5525ed5b-bbb5-405a-90d1-5fad847b5729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '707951ae-f982-43df-9a3a-62f3bce41ab8', 'volume_name': 'volume-707951ae-f982-43df-9a3a-62f3bce41ab8', 'volume_size': 1, 'snapshot_id': '164fc993-fd7d-4605-81e6-a800719efd7e'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64b6bc6-32b6-422c-8751-f139f7a0ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64b6bc6-32b6-422c-8751-f139f7a0ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc032c67-2445-42ab-b45f-358a0fae681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:37 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Volume 707951ae-f982-43df-9a3a-62f3bce41ab8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-707951ae-f982-43df-9a3a-62f3bce41ab8', 'volume_size': 1, 'snapshot_id': '164fc993-fd7d-4605-81e6-a800719efd7e'}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "cinder-quobyte-164fc993-fd7d-4605-81e6-a800719efd7e-707951ae-f982-43df-9a3a-62f3bce41ab8" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-164fc993-fd7d-4605-81e6-a800719efd7e-707951ae-f982-43df-9a3a-62f3bce41ab8" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Creating volume 707951ae-f982-43df-9a3a-62f3bce41ab8 from snapshot 164fc993-fd7d-4605-81e6-a800719efd7e {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "cinder-quobyte-707951ae-f982-43df-9a3a-62f3bce41ab8" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-707951ae-f982-43df-9a3a-62f3bce41ab8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] snapshot: 164fc993-fd7d-4605-81e6-a800719efd7e, volume: 707951ae-f982-43df-9a3a-62f3bce41ab8,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c537ad4-5f41-4fa8-ac3e-10a1ae7b9840]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:31:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:38 devstack sudo[104202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e
Nov 05 04:31:38 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:38 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e" returned: 0 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f65dd43-dea8-4950-be2b-3648410b5809(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:31:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e471c3-77fa-43b3-8b94-4a2459e7c084]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:31:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:38 devstack sudo[104209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809
Nov 05 04:31:38 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:38 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809" returned: 0 in 0.404s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:31:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:31:38 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:31:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:38 devstack sudo[104215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8
Nov 05 04:31:38 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:47 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=12,cinder:SELECT=5,cinder:DELETE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:31:47 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:31:48 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8" returned: 0 in 9.316s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809, size 1024.00 MB, duration 9.32 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:31:48 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Converted 1024.00 MB image at 109.90 MB/s
Nov 05 04:31:48 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8 is being set with open permissions: ugo+rw
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:48 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8
Nov 05 04:31:48 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:48 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-707951ae-f982-43df-9a3a-62f3bce41ab8" released by "_copy_volume_from_snapshot" :: held 10.538s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-164fc993-fd7d-4605-81e6-a800719efd7e-707951ae-f982-43df-9a3a-62f3bce41ab8" released by "_create_volume_from_snapshot" :: held 10.614s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.631s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc032c67-2445-42ab-b45f-358a0fae681d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-707951ae-f982-43df-9a3a-62f3bce41ab8', 'volume_size': 1, 'snapshot_id': '164fc993-fd7d-4605-81e6-a800719efd7e'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2559a3ea-a032-432a-98d0-84abd90e6718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:31:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Volume volume-707951ae-f982-43df-9a3a-62f3bce41ab8 (707951ae-f982-43df-9a3a-62f3bce41ab8): created successfully
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2559a3ea-a032-432a-98d0-84abd90e6718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:31:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Flow 'volume_create_manager' (17a4f0a6-5d22-4276-ace7-d3df3e794a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:31:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5123f27e-ccad-4385-8c05-68de5466ee6b tempest-SnapshotDependencyTests-890825908 None] Created volume successfully.
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "cinder-164fc993-fd7d-4605-81e6-a800719efd7e-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-164fc993-fd7d-4605-81e6-a800719efd7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "cinder-quobyte-4f65dd43-dea8-4950-be2b-3648410b5809" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-4f65dd43-dea8-4950-be2b-3648410b5809" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "cinder-quobyte-164fc993-fd7d-4605-81e6-a800719efd7e" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-164fc993-fd7d-4605-81e6-a800719efd7e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Deleting offline snapshot 164fc993-fd7d-4605-81e6-a800719efd7e of volume 4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] snapshot_file for this snap is: volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5b4529-c484-49f3-9789-4905a4a21d77]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:49 devstack sudo[104301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e
Nov 05 04:31:49 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:49 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f65dd43-dea8-4950-be2b-3648410b5809(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c4e6b5-f06f-4c7e-aceb-70af1714d485]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:31:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:49 devstack sudo[104306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809
Nov 05 04:31:49 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:50 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809" returned: 0 in 0.579s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:50 devstack sudo[104312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e
Nov 05 04:31:50 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:50 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:50 devstack sudo[104317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e
Nov 05 04:31:50 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:50 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809.164fc993-fd7d-4605-81e6-a800719efd7e" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-164fc993-fd7d-4605-81e6-a800719efd7e" released by "_delete_snapshot" :: held 1.654s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-4f65dd43-dea8-4950-be2b-3648410b5809" released by "delete_snapshot" :: held 1.682s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:50 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Created reservations ['327ba5f0-7964-41aa-8d93-79aca3190c7a', '6c615097-8ed8-4ef2-a441-ef2bea000f8b', '5268fae4-0010-4f37-8101-d009eb853648', '186e98c4-c1f0-46de-be7e-ad6a1edc4465'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:31:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Delete snapshot completed successfully.
Nov 05 04:31:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d16c0edb-b8f5-4567-8244-99ba89805983 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-164fc993-fd7d-4605-81e6-a800719efd7e-delete_snapshot" released by "delete_snapshot" :: held 1.826s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "cinder-4f65dd43-dea8-4950-be2b-3648410b5809-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-4f65dd43-dea8-4950-be2b-3648410b5809-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "cinder-quobyte-4f65dd43-dea8-4950-be2b-3648410b5809" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-4f65dd43-dea8-4950-be2b-3648410b5809" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4428ad-701a-4af7-9015-abf096a2ba53]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:51 devstack sudo[104320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809
Nov 05 04:31:51 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:51 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:51 devstack sudo[104325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809
Nov 05 04:31:51 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:52 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4f65dd43-dea8-4950-be2b-3648410b5809" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-4f65dd43-dea8-4950-be2b-3648410b5809" released by "delete_volume" :: held 0.712s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Created reservations ['fc69adf5-6905-4589-868d-3f740e707340', '469a1d55-4691-442a-bfcf-b57a5ff55b04', 'b20db0fe-d43e-4b38-9c4f-97bec284173b', 'f42e1aaa-7c2f-4497-9cc6-83a5a37dffc4'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:52 devstack sudo[104328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:31:52 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:52 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:31:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Deleted volume successfully.
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52c5d9d2-a752-4b57-a0dc-758c930f0851 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-4f65dd43-dea8-4950-be2b-3648410b5809-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "cinder-707951ae-f982-43df-9a3a-62f3bce41ab8-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-707951ae-f982-43df-9a3a-62f3bce41ab8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "cinder-quobyte-707951ae-f982-43df-9a3a-62f3bce41ab8" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-707951ae-f982-43df-9a3a-62f3bce41ab8" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4785b350-98fc-4b6a-8236-8d40df99e74c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:31:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:53 devstack sudo[104332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8
Nov 05 04:31:53 devstack sudo[104332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:53 devstack sudo[104332]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:53 devstack sudo[104337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8
Nov 05 04:31:53 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:53 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-707951ae-f982-43df-9a3a-62f3bce41ab8" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-quobyte-707951ae-f982-43df-9a3a-62f3bce41ab8" released by "delete_volume" :: held 0.683s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Created reservations ['b576f0fc-3ac2-439c-9a23-bf4b820f8fab', 'a2c8104c-e8ca-472d-8b9f-719f1a1078ad', '765f8846-661d-489e-ad9a-d42a5505d82a', '12b812f2-221a-4c4b-8158-4e2c65487f5f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:31:53 devstack sudo[104340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:31:53 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:31:53 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:31:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Deleted volume successfully.
Nov 05 04:31:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e2bed57b-7ee4-43cd-b8f7-fda9ca9b70b6 tempest-SnapshotDependencyTests-890825908 None] Lock "cinder-707951ae-f982-43df-9a3a-62f3bce41ab8-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:32:03 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:32:03 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=18,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=10 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:32:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-574b552a-699e-4b6f-b4fa-8e94386f5726 req-95863146-df97-484b-b3e5-90539328e82c tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:32:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-574b552a-699e-4b6f-b4fa-8e94386f5726 req-95863146-df97-484b-b3e5-90539328e82c tempest-TestStampPattern-1946862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:32:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-574b552a-699e-4b6f-b4fa-8e94386f5726 req-95863146-df97-484b-b3e5-90539328e82c tempest-TestStampPattern-1946862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:32:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-574b552a-699e-4b6f-b4fa-8e94386f5726 req-95863146-df97-484b-b3e5-90539328e82c tempest-TestStampPattern-1946862965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc18e44b-1d32-4b24-ba03-298b36574b9a', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:32:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-574b552a-699e-4b6f-b4fa-8e94386f5726 req-95863146-df97-484b-b3e5-90539328e82c tempest-TestStampPattern-1946862965 None] attachment_update completed successfully.
Nov 05 04:32:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-2387abdc-e3df-4468-be85-980c70007832 req-d573c862-8beb-4fc6-86ff-75c37f7cc38a tempest-TestStampPattern-1946862965 None] Terminate volume connection completed successfully.
Nov 05 04:32:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-2387abdc-e3df-4468-be85-980c70007832 req-d573c862-8beb-4fc6-86ff-75c37f7cc38a tempest-TestStampPattern-1946862965 None] Deleting attachment cc18e44b-1d32-4b24-ba03-298b36574b9a. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:32:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Creating offline snapshot 7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 of volume 8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:32:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ba856-8310-4dce-aa58-71899d99d26a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:13 devstack sudo[104849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9
Nov 05 04:32:13 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:13 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:13 devstack sudo[104856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 1G
Nov 05 04:32:13 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:14 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 1G" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:14 devstack sudo[104861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8
Nov 05 04:32:14 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:14 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8" returned: 0 in 0.295s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:14 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 is being set with open permissions: ugo+rw
Nov 05 04:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:14 devstack sudo[104866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8
Nov 05 04:32:14 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:14 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:14 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.info
Nov 05 04:32:14 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:15 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.info" returned: 0 in 0.258s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:15 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.info is being set with open permissions: ugo+rw
Nov 05 04:32:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:15 devstack sudo[104872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.info
Nov 05 04:32:15 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:15 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.info" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:32:15 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1d7274c3-231c-4249-aa3d-27c3c9366fc1 tempest-TestStampPattern-1946862965 None] Create snapshot completed successfully
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Flow 'volume_create_manager' (11fd0762-aec8-4b4c-9b93-4f26e8b95d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf3d0eb-db4e-40b8-9f25-c4c365e6e3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf3d0eb-db4e-40b8-9f25-c4c365e6e3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:32:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1527482770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cabdb1f-d993-4450-ab11-d5299f71db52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0f5e36f618943949a241555f061b7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:32:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7d4514bc-70bb-4875-8ffd-dd1e29e15cf8,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:32:22Z,use_quota=True,user_id='162b0f07dd8147178bf2616bd46597ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f0f0d0-a559-42ec-9fd6-d2f5557f0a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f0f0d0-a559-42ec-9fd6-d2f5557f0a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f963af-6fcb-432b-9157-4706ccdf486b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f963af-6fcb-432b-9157-4706ccdf486b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5cabdb1f-d993-4450-ab11-d5299f71db52', 'volume_name': 'volume-5cabdb1f-d993-4450-ab11-d5299f71db52', 'volume_size': 1, 'snapshot_id': '7d4514bc-70bb-4875-8ffd-dd1e29e15cf8'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a97c33f-32d5-46c1-83ea-67a13ea3bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a97c33f-32d5-46c1-83ea-67a13ea3bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5196bf75-bc25-42e8-8ab1-04059a8b76c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:32:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Volume 5cabdb1f-d993-4450-ab11-d5299f71db52: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5cabdb1f-d993-4450-ab11-d5299f71db52', 'volume_size': 1, 'snapshot_id': '7d4514bc-70bb-4875-8ffd-dd1e29e15cf8'}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Acquiring lock "cinder-quobyte-7d4514bc-70bb-4875-8ffd-dd1e29e15cf8-5cabdb1f-d993-4450-ab11-d5299f71db52" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-7d4514bc-70bb-4875-8ffd-dd1e29e15cf8-5cabdb1f-d993-4450-ab11-d5299f71db52" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Creating volume 5cabdb1f-d993-4450-ab11-d5299f71db52 from snapshot 7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Acquiring lock "cinder-quobyte-5cabdb1f-d993-4450-ab11-d5299f71db52" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-5cabdb1f-d993-4450-ab11-d5299f71db52" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] snapshot: 7d4514bc-70bb-4875-8ffd-dd1e29e15cf8, volume: 5cabdb1f-d993-4450-ab11-d5299f71db52,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb76fac-674c-4e41-9b8f-e480c97a2d19]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:22 devstack sudo[104908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8
Nov 05 04:32:22 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:22 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8" returned: 0 in 0.382s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8995202-a1e6-40e9-be16-d43b094c96f2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:32:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:22 devstack sudo[104913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9
Nov 05 04:32:22 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:23 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:32:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:32:23 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52 not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:32:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:23 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52
Nov 05 04:32:23 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:29 devstack sudo[104960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:32:29 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:29 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.601s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:32:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:32:32 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52" returned: 0 in 9.217s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9, size 1024.00 MB, duration 9.22 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:32:32 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Converted 1024.00 MB image at 111.07 MB/s
Nov 05 04:32:32 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52 is being set with open permissions: ugo+rw
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:32:32 devstack sudo[105016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52
Nov 05 04:32:32 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:32:32 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52" returned: 0 in 0.282s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-5cabdb1f-d993-4450-ab11-d5299f71db52" released by "_copy_volume_from_snapshot" :: held 10.371s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-7d4514bc-70bb-4875-8ffd-dd1e29e15cf8-5cabdb1f-d993-4450-ab11-d5299f71db52" released by "_create_volume_from_snapshot" :: held 10.453s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.472s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5196bf75-bc25-42e8-8ab1-04059a8b76c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cabdb1f-d993-4450-ab11-d5299f71db52', 'volume_size': 1, 'snapshot_id': '7d4514bc-70bb-4875-8ffd-dd1e29e15cf8'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae1c57b-86f7-467a-878f-a376ac5dd64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:32:32 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Volume volume-5cabdb1f-d993-4450-ab11-d5299f71db52 (5cabdb1f-d993-4450-ab11-d5299f71db52): created successfully
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cae1c57b-86f7-467a-878f-a376ac5dd64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:32:32 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Flow 'volume_create_manager' (11fd0762-aec8-4b4c-9b93-4f26e8b95d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:32:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ec145967-8d0a-478f-9165-bda3133b92c1 tempest-TestStampPattern-1946862965 None] Created volume successfully.
Nov 05 04:32:42 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:32:42 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-55d540ff-42c1-4b2c-880a-e41d8e391ff3 req-77105c69-8dec-473e-958c-6cda82f2f9f8 tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-55d540ff-42c1-4b2c-880a-e41d8e391ff3 req-77105c69-8dec-473e-958c-6cda82f2f9f8 tempest-TestStampPattern-1946862965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [req-55d540ff-42c1-4b2c-880a-e41d8e391ff3 req-77105c69-8dec-473e-958c-6cda82f2f9f8 tempest-TestStampPattern-1946862965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-55d540ff-42c1-4b2c-880a-e41d8e391ff3 req-77105c69-8dec-473e-958c-6cda82f2f9f8 tempest-TestStampPattern-1946862965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574', 'name': 'volume-5cabdb1f-d993-4450-ab11-d5299f71db52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55da7b4b-f988-4f58-9e03-66cc20be94b8', 'enforce_multipath': True} {{(pid=87166) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 05 04:33:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-55d540ff-42c1-4b2c-880a-e41d8e391ff3 req-77105c69-8dec-473e-958c-6cda82f2f9f8 tempest-TestStampPattern-1946862965 None] attachment_update completed successfully.
Nov 05 04:33:14 devstack cinder-volume[87166]: INFO cinder.volume.manager [req-87f37712-0151-4723-8719-a4a40d6dc18d req-c88a639d-746b-4e39-9aed-561b0066fe8c tempest-TestStampPattern-1946862965 None] Terminate volume connection completed successfully.
Nov 05 04:33:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [req-87f37712-0151-4723-8719-a4a40d6dc18d req-c88a639d-746b-4e39-9aed-561b0066fe8c tempest-TestStampPattern-1946862965 None] Deleting attachment 55da7b4b-f988-4f58-9e03-66cc20be94b8. {{(pid=87166) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Acquiring lock "cinder-5cabdb1f-d993-4450-ab11-d5299f71db52-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Lock "cinder-5cabdb1f-d993-4450-ab11-d5299f71db52-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Acquiring lock "cinder-quobyte-5cabdb1f-d993-4450-ab11-d5299f71db52" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-5cabdb1f-d993-4450-ab11-d5299f71db52" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e968ae17-f38d-439a-9727-16978c0a7216]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:19 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52
Nov 05 04:33:19 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:19 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52" returned: 0 in 0.345s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:19 devstack sudo[105590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52
Nov 05 04:33:19 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:19 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-5cabdb1f-d993-4450-ab11-d5299f71db52" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-5cabdb1f-d993-4450-ab11-d5299f71db52" released by "delete_volume" :: held 0.632s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Created reservations ['f1ecf04f-c539-4a34-8bde-d9c9ad2f3629', '93a1875c-3785-4ea9-81bd-d8418a47ee40', 'b8aa6149-2064-45d3-97b1-350fc2885b69', '85388ad9-f2f7-4d26-ac5f-e5b8d751e253'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:19 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:19 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:20 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:33:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Deleted volume successfully.
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f83deb52-c5e8-4c6f-be8a-cdc0e1a671e9 tempest-TestStampPattern-1946862965 None] Lock "cinder-5cabdb1f-d993-4450-ab11-d5299f71db52-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Acquiring lock "cinder-7d4514bc-70bb-4875-8ffd-dd1e29e15cf8-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Lock "cinder-7d4514bc-70bb-4875-8ffd-dd1e29e15cf8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Acquiring lock "cinder-quobyte-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Acquiring lock "cinder-quobyte-7d4514bc-70bb-4875-8ffd-dd1e29e15cf8" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-7d4514bc-70bb-4875-8ffd-dd1e29e15cf8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Deleting offline snapshot 7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 of volume 8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] snapshot_file for this snap is: volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e03c55-7bee-4a6d-873c-cf56ea2e47ea]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:20 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8
Nov 05 04:33:20 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:20 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8" returned: 0 in 0.364s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[beff39ff-b095-48a7-96df-ad94f89eccfc]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:21 devstack sudo[105602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9
Nov 05 04:33:21 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:21 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" returned: 0 in 0.520s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:21 devstack sudo[105607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8
Nov 05 04:33:21 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:21 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8" returned: 0 in 0.323s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:21 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8
Nov 05 04:33:21 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:22 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9.7d4514bc-70bb-4875-8ffd-dd1e29e15cf8" returned: 0 in 0.244s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-7d4514bc-70bb-4875-8ffd-dd1e29e15cf8" released by "_delete_snapshot" :: held 1.548s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" released by "delete_snapshot" :: held 1.569s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Created reservations ['12a5ed77-dbf5-4a04-831c-86e54eb3092d', '8ddab08a-1742-429b-88f6-901972c1e7ec', '717fb828-0b9b-4c20-b390-31879018a189', '9c1dc018-d266-4632-af5c-1835f2811977'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Delete snapshot completed successfully.
Nov 05 04:33:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cd9ca7f4-b0e0-456e-acc7-1d87b10655b3 tempest-TestStampPattern-1946862965 None] Lock "cinder-7d4514bc-70bb-4875-8ffd-dd1e29e15cf8-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Acquiring lock "cinder-8268ac54-1ad8-4830-805b-cdc78ee9e8f9-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Lock "cinder-8268ac54-1ad8-4830-805b-cdc78ee9e8f9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Acquiring lock "cinder-quobyte-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d5ac2-981d-4829-a8f1-c9c22a632778]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:26 devstack sudo[105641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9
Nov 05 04:33:26 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:26 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:26 devstack sudo[105646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9
Nov 05 04:33:26 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:26 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Lock "cinder-quobyte-8268ac54-1ad8-4830-805b-cdc78ee9e8f9" released by "delete_volume" :: held 0.650s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Created reservations ['8b9c015f-6b8f-4dc4-8984-854c813fc7f3', 'b4e8d41e-86e0-40da-865f-82497b94d150', '847b38f7-a591-4efc-9348-21946cbcd54c', '7681d955-0eeb-4031-9443-1f917e271322'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:26 devstack sudo[105649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:26 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:27 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.244s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:27 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:33:27 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Deleted volume successfully.
Nov 05 04:33:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-866dda18-b935-4881-acb4-1b61e9969aa0 tempest-TestStampPattern-1946862965 None] Lock "cinder-8268ac54-1ad8-4830-805b-cdc78ee9e8f9-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:29 devstack sudo[105658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:29 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:29 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:33:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:33:36 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=27,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:33:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (9f1630a2-dd59-4a9a-adf7-7d845e471316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02623ced-e428-4e8f-8258-a4072fc11afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02623ced-e428-4e8f-8258-a4072fc11afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-804640871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729ee1c5-4db3-4c57-9719-70687ede2e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:38Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135cfaf5-8733-4b9d-9e67-3c06fa25abd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135cfaf5-8733-4b9d-9e67-3c06fa25abd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f8b6a0-9c7b-4c69-afac-dd0d02a30a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68f8b6a0-9c7b-4c69-afac-dd0d02a30a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '729ee1c5-4db3-4c57-9719-70687ede2e64', 'volume_name': 'volume-729ee1c5-4db3-4c57-9719-70687ede2e64', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348bde79-82f5-47ce-96cc-a1e2a769f0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348bde79-82f5-47ce-96cc-a1e2a769f0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89c0c72-d8fd-435a-bff5-9a569ce535cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Volume 729ee1c5-4db3-4c57-9719-70687ede2e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-729ee1c5-4db3-4c57-9719-70687ede2e64', 'volume_size': 1}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-804640871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=729ee1c5-4db3-4c57-9719-70687ede2e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:38Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Creating volume 729ee1c5-4db3-4c57-9719-70687ede2e64 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:38 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:38 devstack sudo[105702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64 1073741824
Nov 05 04:33:38 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (e5fe7bdd-5c04-4760-9cd5-d41c914d35cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9722aff6-efc1-4f33-8a53-f9a4b3eabacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9722aff6-efc1-4f33-8a53-f9a4b3eabacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807557021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f263040f-27d5-458f-a543-b6982df9a938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:39Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6907ac0-a269-4223-acc6-a300c2bd3929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6907ac0-a269-4223-acc6-a300c2bd3929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9660862-bdc0-4026-ad80-a53bb8914e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9660862-bdc0-4026-ad80-a53bb8914e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f263040f-27d5-458f-a543-b6982df9a938', 'volume_name': 'volume-f263040f-27d5-458f-a543-b6982df9a938', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c4baa-4131-4822-87d2-b8f1273c7248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c87c4baa-4131-4822-87d2-b8f1273c7248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ecd8fe-0aba-4ce7-a0df-180abb260beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Volume f263040f-27d5-458f-a543-b6982df9a938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f263040f-27d5-458f-a543-b6982df9a938', 'volume_size': 1}
Nov 05 04:33:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:39 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64 1073741824" returned: 0 in 0.495s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:39 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64
Nov 05 04:33:39 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (8230b636-a8a0-4c41-99c9-018edd164036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1317fd7f-d25a-4607-bd2e-dcff3e697797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1317fd7f-d25a-4607-bd2e-dcff3e697797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-882466060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15906203-8dd0-4f1d-9a54-71564eebe138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:39Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4226b3d7-a109-4f05-948c-80d4bd5e3333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4226b3d7-a109-4f05-948c-80d4bd5e3333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31146fbf-08d5-40e9-a95b-8ad08f99ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31146fbf-08d5-40e9-a95b-8ad08f99ae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15906203-8dd0-4f1d-9a54-71564eebe138', 'volume_name': 'volume-15906203-8dd0-4f1d-9a54-71564eebe138', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a387a548-f873-44b2-a568-b7d9ef8afcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a387a548-f873-44b2-a568-b7d9ef8afcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c0643e-0cb7-482c-a8bd-3fa9e183b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Volume 15906203-8dd0-4f1d-9a54-71564eebe138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15906203-8dd0-4f1d-9a54-71564eebe138', 'volume_size': 1}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:39 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.469s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-807557021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f263040f-27d5-458f-a543-b6982df9a938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:39Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Creating volume f263040f-27d5-458f-a543-b6982df9a938 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:39 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89c0c72-d8fd-435a-bff5-9a569ce535cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-729ee1c5-4db3-4c57-9719-70687ede2e64', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack sudo[105714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938 1073741824
Nov 05 04:33:39 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd4c098-7bbf-457f-b9e6-c4d6059de76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Volume volume-729ee1c5-4db3-4c57-9719-70687ede2e64 (729ee1c5-4db3-4c57-9719-70687ede2e64): created successfully
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd4c098-7bbf-457f-b9e6-c4d6059de76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (9f1630a2-dd59-4a9a-adf7-7d845e471316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8962321a-2f3d-41eb-9d5a-6928ca4204a5 tempest-CreateVolumesFromImageTest-1367033044 None] Created volume successfully.
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (f6d5a2bb-7997-45a4-b975-91aae8a3c85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac188409-51ec-45d8-a0e7-9842d0fa3e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac188409-51ec-45d8-a0e7-9842d0fa3e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1275115767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30866a8b-e938-416b-ba22-0abb0a285349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:40Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5adc9b-67d5-49c8-b3cc-10d54506f699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5adc9b-67d5-49c8-b3cc-10d54506f699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1318eaa-d347-4b0b-a6c4-f51e60010c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1318eaa-d347-4b0b-a6c4-f51e60010c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30866a8b-e938-416b-ba22-0abb0a285349', 'volume_name': 'volume-30866a8b-e938-416b-ba22-0abb0a285349', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cfaf7f-a00e-454a-8590-c784fcf60b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2cfaf7f-a00e-454a-8590-c784fcf60b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d6a118-ec53-425d-acd1-07559ef81088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Volume 30866a8b-e938-416b-ba22-0abb0a285349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30866a8b-e938-416b-ba22-0abb0a285349', 'volume_size': 1}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:39 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938 1073741824" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (6797729c-0d85-44f0-bb23-8c7ebc881cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0d2e23-99ff-427b-a18f-c04d2a1d1a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0d2e23-99ff-427b-a18f-c04d2a1d1a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1913213614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebba7ffd-d056-4e9d-afe4-954b79def5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:40Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:40 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938
Nov 05 04:33:40 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535e8015-199f-4ab7-8a67-858ade35f3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (535e8015-199f-4ab7-8a67-858ade35f3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076ddda7-a409-4ad0-ae83-0fd519580bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076ddda7-a409-4ad0-ae83-0fd519580bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebba7ffd-d056-4e9d-afe4-954b79def5ca', 'volume_name': 'volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876393c5-fde2-4335-9ac1-b4279ac6b498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876393c5-fde2-4335-9ac1-b4279ac6b498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa5d842-9bee-4da7-a80c-d1bb63f15b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:40 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Volume ebba7ffd-d056-4e9d-afe4-954b79def5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca', 'volume_size': 1}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:40 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.926s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-882466060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15906203-8dd0-4f1d-9a54-71564eebe138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:39Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Creating volume 15906203-8dd0-4f1d-9a54-71564eebe138 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ecd8fe-0aba-4ce7-a0df-180abb260beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f263040f-27d5-458f-a543-b6982df9a938', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:40 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138 1073741824
Nov 05 04:33:40 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc356656-1f40-4168-912f-003e5b321565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:40 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Volume volume-f263040f-27d5-458f-a543-b6982df9a938 (f263040f-27d5-458f-a543-b6982df9a938): created successfully
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc356656-1f40-4168-912f-003e5b321565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (e5fe7bdd-5c04-4760-9cd5-d41c914d35cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f9f242f6-813a-4464-b425-5d2becbc1844 tempest-CreateVolumesFromImageTest-1367033044 None] Created volume successfully.
Nov 05 04:33:40 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138 1073741824" returned: 0 in 0.413s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:40 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138
Nov 05 04:33:40 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:40 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1275115767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30866a8b-e938-416b-ba22-0abb0a285349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:40Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Creating volume 30866a8b-e938-416b-ba22-0abb0a285349 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6c0643e-0cb7-482c-a8bd-3fa9e183b73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15906203-8dd0-4f1d-9a54-71564eebe138', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9575dde0-70da-4eff-8ccb-3b1b9a770067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:40 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349 1073741824
Nov 05 04:33:40 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:40 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Volume volume-15906203-8dd0-4f1d-9a54-71564eebe138 (15906203-8dd0-4f1d-9a54-71564eebe138): created successfully
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9575dde0-70da-4eff-8ccb-3b1b9a770067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (8230b636-a8a0-4c41-99c9-018edd164036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b02fdd24-dd32-422c-8515-718d46d33793 tempest-CreateVolumesFromImageTest-1367033044 None] Created volume successfully.
Nov 05 04:33:41 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349 1073741824" returned: 0 in 0.407s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:41 devstack sudo[105737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349
Nov 05 04:33:41 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:41 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1913213614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebba7ffd-d056-4e9d-afe4-954b79def5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7a8ec987e6a4e6884e05ef7485b6058',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:40Z,use_quota=True,user_id='a8c16164d50e4865ad4d9e6da0cdb311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Creating volume ebba7ffd-d056-4e9d-afe4-954b79def5ca {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:41 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d6a118-ec53-425d-acd1-07559ef81088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30866a8b-e938-416b-ba22-0abb0a285349', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42c8fa4-bebb-43fd-a1e8-748b9baa2f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:41 devstack sudo[105740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca 1073741824
Nov 05 04:33:41 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Volume volume-30866a8b-e938-416b-ba22-0abb0a285349 (30866a8b-e938-416b-ba22-0abb0a285349): created successfully
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42c8fa4-bebb-43fd-a1e8-748b9baa2f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (f6d5a2bb-7997-45a4-b975-91aae8a3c85c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cf635447-9e13-4655-be56-5bf92cf2034f tempest-CreateVolumesFromImageTest-1367033044 None] Created volume successfully.
Nov 05 04:33:42 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca 1073741824" returned: 0 in 0.427s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:42 devstack sudo[105745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca
Nov 05 04:33:42 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:42 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa5d842-9bee-4da7-a80c-d1bb63f15b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bfac5e-306f-4805-a3ec-5600a0278ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:42 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Volume volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca (ebba7ffd-d056-4e9d-afe4-954b79def5ca): created successfully
Nov 05 04:33:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bfac5e-306f-4805-a3ec-5600a0278ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Flow 'volume_create_manager' (6797729c-0d85-44f0-bb23-8c7ebc881cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dc2c3571-b303-4ec1-ba37-0fabb44857ae tempest-CreateVolumesFromImageTest-1367033044 None] Created volume successfully.
Nov 05 04:33:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-ebba7ffd-d056-4e9d-afe4-954b79def5ca-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-ebba7ffd-d056-4e9d-afe4-954b79def5ca-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-quobyte-ebba7ffd-d056-4e9d-afe4-954b79def5ca" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-ebba7ffd-d056-4e9d-afe4-954b79def5ca" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[86362c71-84a7-44c6-9c03-476a8a314270]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:43 devstack sudo[105748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca
Nov 05 04:33:43 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:43 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:43 devstack sudo[105753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca
Nov 05 04:33:43 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:44 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ebba7ffd-d056-4e9d-afe4-954b79def5ca" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-ebba7ffd-d056-4e9d-afe4-954b79def5ca" released by "delete_volume" :: held 0.639s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Created reservations ['a190a21f-4ef1-4c07-903c-9b6f65aa46f8', '4943f68c-63d6-4dfa-8e22-ba4a7e1f8b21', 'c91962a8-78cb-4b3f-8fd6-b15d7c2f982a', 'cb761ec7-df8d-4f83-a9b9-1f39d20394c5'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:44 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:44 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:44 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.235s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:33:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Deleted volume successfully.
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-372a5925-502f-4cdc-839d-539275e70e0d tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-ebba7ffd-d056-4e9d-afe4-954b79def5ca-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-30866a8b-e938-416b-ba22-0abb0a285349-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-30866a8b-e938-416b-ba22-0abb0a285349-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-quobyte-30866a8b-e938-416b-ba22-0abb0a285349" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-30866a8b-e938-416b-ba22-0abb0a285349" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79c1b9f-27ef-4753-9899-d0f5ac388fa0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:44 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349
Nov 05 04:33:44 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:44 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:44 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349
Nov 05 04:33:44 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:45 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-30866a8b-e938-416b-ba22-0abb0a285349" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-30866a8b-e938-416b-ba22-0abb0a285349" released by "delete_volume" :: held 0.645s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Created reservations ['30e2ed81-35fe-4ea7-8137-1395455f7816', '4a70bf64-353c-430b-8eb0-3774545ae86c', '71ca14e4-23f6-4f1d-b340-1b7a10542e04', 'b8af8ac5-263a-4c1f-8e92-78b1a384b496'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:45 devstack sudo[105767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:45 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:45 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:33:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Deleted volume successfully.
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-130cd1cc-2d87-4a9e-9962-ad8cf007b2a3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-30866a8b-e938-416b-ba22-0abb0a285349-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-15906203-8dd0-4f1d-9a54-71564eebe138-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-15906203-8dd0-4f1d-9a54-71564eebe138-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-quobyte-15906203-8dd0-4f1d-9a54-71564eebe138" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-15906203-8dd0-4f1d-9a54-71564eebe138" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[735f484b-5bfb-4870-a9cb-71b96168ec22]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:45 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138
Nov 05 04:33:45 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:46 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:46 devstack sudo[105775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138
Nov 05 04:33:46 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:46 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-15906203-8dd0-4f1d-9a54-71564eebe138" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-15906203-8dd0-4f1d-9a54-71564eebe138" released by "delete_volume" :: held 0.631s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Created reservations ['8c7eae3d-3022-4357-9784-af1e342c2888', 'eed13b78-c9b1-473f-bdbd-f04bdc64cd98', '9af202ae-2885-49c9-a753-f2f6f32d7f1d', 'ffa242a5-bbe5-4e4f-85e3-0098742202a8'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:46 devstack sudo[105778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:46 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:46 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.235s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:33:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Deleted volume successfully.
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4b4bc197-8b3d-4e34-b5c4-a9ac5ae2e3f3 tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-15906203-8dd0-4f1d-9a54-71564eebe138-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-f263040f-27d5-458f-a543-b6982df9a938-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-f263040f-27d5-458f-a543-b6982df9a938-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-quobyte-f263040f-27d5-458f-a543-b6982df9a938" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-f263040f-27d5-458f-a543-b6982df9a938" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d365b788-ac3c-498a-9e59-d88768ea5a2e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:47 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938
Nov 05 04:33:47 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:47 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:47 devstack sudo[105786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938
Nov 05 04:33:47 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:47 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f263040f-27d5-458f-a543-b6982df9a938" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-f263040f-27d5-458f-a543-b6982df9a938" released by "delete_volume" :: held 0.633s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Created reservations ['8a92b6cd-37b2-4a26-a284-dd7015bedd69', '9cfc0619-dd2e-4ab9-84a1-c1cbaef424f5', '96d1edec-08e0-4de8-88d5-f22d99fa4afe', '416af356-a821-4f4c-9cc2-9a57baf6c785'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:47 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:47 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:47 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.236s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:33:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Deleted volume successfully.
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76b0fa72-464a-4038-a73c-7bc25b08824e tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-f263040f-27d5-458f-a543-b6982df9a938-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-729ee1c5-4db3-4c57-9719-70687ede2e64-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-729ee1c5-4db3-4c57-9719-70687ede2e64-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "cinder-quobyte-729ee1c5-4db3-4c57-9719-70687ede2e64" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-729ee1c5-4db3-4c57-9719-70687ede2e64" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e4300-1cf1-4a2c-8776-793b7db6c8bc]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:48 devstack sudo[105792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64
Nov 05 04:33:48 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:48 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64" returned: 0 in 0.348s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:48 devstack sudo[105797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64
Nov 05 04:33:48 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:48 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-729ee1c5-4db3-4c57-9719-70687ede2e64" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-quobyte-729ee1c5-4db3-4c57-9719-70687ede2e64" released by "delete_volume" :: held 0.635s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Created reservations ['d66868de-2dd1-4b11-bf26-718e10d88c9f', 'efb2a665-236c-450d-96e1-bd49726d2c72', '48a8c0cd-5bc3-4125-97c5-05251546b439', '7fd7b175-83e1-4cb0-a813-660da343b281'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:48 devstack sudo[105800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:48 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:49 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:49 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:33:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Deleted volume successfully.
Nov 05 04:33:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-869e98a3-0db2-4487-a9dd-66c7b0163c1b tempest-CreateVolumesFromImageTest-1367033044 None] Lock "cinder-729ee1c5-4db3-4c57-9719-70687ede2e64-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (d36c40f2-6b82-478b-997e-297ec9c94e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51894fd-e135-4612-9c76-e0e90dc693c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51894fd-e135-4612-9c76-e0e90dc693c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1731831029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d58eef-e788-46be-8acc-8ddcbcf66117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:52Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1a0b11-e791-4eb7-83a4-99b7496ff855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1a0b11-e791-4eb7-83a4-99b7496ff855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7245710-837a-4378-9653-f39f09363058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7245710-837a-4378-9653-f39f09363058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d58eef-e788-46be-8acc-8ddcbcf66117', 'volume_name': 'volume-99d58eef-e788-46be-8acc-8ddcbcf66117', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414b6a72-467a-4d6d-9269-ca6e4592d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (414b6a72-467a-4d6d-9269-ca6e4592d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09861b0c-b95c-4d0a-8a84-b6510bc3afd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume 99d58eef-e788-46be-8acc-8ddcbcf66117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d58eef-e788-46be-8acc-8ddcbcf66117', 'volume_size': 1}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1731831029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d58eef-e788-46be-8acc-8ddcbcf66117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:52Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Creating volume 99d58eef-e788-46be-8acc-8ddcbcf66117 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:51 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:51 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117 1073741824
Nov 05 04:33:51 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:52 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117 1073741824" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:52 devstack sudo[105809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117
Nov 05 04:33:52 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:52 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117" returned: 0 in 0.237s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09861b0c-b95c-4d0a-8a84-b6510bc3afd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d58eef-e788-46be-8acc-8ddcbcf66117', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672e3427-2a40-42c5-ac19-220b783ae7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume volume-99d58eef-e788-46be-8acc-8ddcbcf66117 (99d58eef-e788-46be-8acc-8ddcbcf66117): created successfully
Nov 05 04:33:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (672e3427-2a40-42c5-ac19-220b783ae7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (d36c40f2-6b82-478b-997e-297ec9c94e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-db8deac1-63b5-4d61-bf0f-27d97e232b61 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created volume successfully.
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (41c7877b-feb7-473d-a056-8e77b1279dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e741a7-e51d-43d3-b89a-ca9cf841ad5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e741a7-e51d-43d3-b89a-ca9cf841ad5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120464662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4550ea89-8133-4fcf-a918-6facb277e88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:53Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48758bac-e1cf-40ac-aef0-4ba6ca11623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48758bac-e1cf-40ac-aef0-4ba6ca11623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0d50fb-42f6-4e1c-8692-0d303b560373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f0d50fb-42f6-4e1c-8692-0d303b560373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4550ea89-8133-4fcf-a918-6facb277e88f', 'volume_name': 'volume-4550ea89-8133-4fcf-a918-6facb277e88f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9be0779-f677-4026-85e3-7e908ad6b098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9be0779-f677-4026-85e3-7e908ad6b098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f060ae8b-39b2-4842-b8db-8a9ed6cece3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume 4550ea89-8133-4fcf-a918-6facb277e88f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4550ea89-8133-4fcf-a918-6facb277e88f', 'volume_size': 1}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120464662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4550ea89-8133-4fcf-a918-6facb277e88f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:53Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Creating volume 4550ea89-8133-4fcf-a918-6facb277e88f {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:53 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:53 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f 1073741824
Nov 05 04:33:53 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (8776cfd5-033e-48ae-b3d7-dca68938c5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9a7029-f8b1-4cec-9598-a0e7965ac68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c9a7029-f8b1-4cec-9598-a0e7965ac68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-397697826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0192203a-3300-4e3e-a7ac-e2ac88ef1e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:53Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4638dc5d-c3a3-4c65-8e1d-b4e2398b182c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4638dc5d-c3a3-4c65-8e1d-b4e2398b182c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9997287-51e3-4688-9935-b65228cfc917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9997287-51e3-4688-9935-b65228cfc917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0192203a-3300-4e3e-a7ac-e2ac88ef1e2b', 'volume_name': 'volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8959d981-1aa9-4fd2-b22f-d245dd923592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8959d981-1aa9-4fd2-b22f-d245dd923592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b485098-2f05-4f6b-8e43-b4bc0cdf8a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume 0192203a-3300-4e3e-a7ac-e2ac88ef1e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b', 'volume_size': 1}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:53 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f 1073741824" returned: 0 in 0.501s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:53 devstack sudo[105818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f
Nov 05 04:33:53 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (2165a3a2-8da6-454f-9b6b-596fa91577db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f36690f-878f-4cb5-83a7-f93d849db689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f36690f-878f-4cb5-83a7-f93d849db689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1558365500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a65ef3-8003-4f6e-967e-13ed5ea1f8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:54Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53395c8d-a134-4c0d-a71d-0a1d6869a7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53395c8d-a134-4c0d-a71d-0a1d6869a7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df61f7ff-9c2b-46ce-8d8d-ca970b5409aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df61f7ff-9c2b-46ce-8d8d-ca970b5409aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66a65ef3-8003-4f6e-967e-13ed5ea1f8e5', 'volume_name': 'volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855c0b99-76f6-408c-a2bf-471a0b0bbd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855c0b99-76f6-408c-a2bf-471a0b0bbd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65754f34-0bea-4422-9e13-7878ed036d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume 66a65ef3-8003-4f6e-967e-13ed5ea1f8e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5', 'volume_size': 1}
Nov 05 04:33:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:54 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f" returned: 0 in 0.315s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-397697826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0192203a-3300-4e3e-a7ac-e2ac88ef1e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:53Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Creating volume 0192203a-3300-4e3e-a7ac-e2ac88ef1e2b {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:54 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f060ae8b-39b2-4842-b8db-8a9ed6cece3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4550ea89-8133-4fcf-a918-6facb277e88f', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack sudo[105821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b 1073741824
Nov 05 04:33:54 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b72c255-41aa-4314-a6df-78055ca57d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume volume-4550ea89-8133-4fcf-a918-6facb277e88f (4550ea89-8133-4fcf-a918-6facb277e88f): created successfully
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b72c255-41aa-4314-a6df-78055ca57d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (41c7877b-feb7-473d-a056-8e77b1279dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cf3f350b-6bd7-489a-bbd3-662e0ab7bd9a tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created volume successfully.
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (8a9e863b-d70a-438b-bb40-c5f18d1b9aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0e5ebf-0735-4774-be32-abf7db5ce1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0e5ebf-0735-4774-be32-abf7db5ce1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-659820037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e27345-437e-412d-9afa-a91c20e41997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:54Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8ae93a-b588-4fa4-94ce-8dc136aa8aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db8ae93a-b588-4fa4-94ce-8dc136aa8aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea26de7-9547-467b-935a-3978c3fe76eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea26de7-9547-467b-935a-3978c3fe76eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e27345-437e-412d-9afa-a91c20e41997', 'volume_name': 'volume-79e27345-437e-412d-9afa-a91c20e41997', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5384dab-857b-452d-9619-00e3aafa3548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5384dab-857b-452d-9619-00e3aafa3548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd738ca-889a-4b54-ab08-06216fc7f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume 79e27345-437e-412d-9afa-a91c20e41997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e27345-437e-412d-9afa-a91c20e41997', 'volume_size': 1}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (90ca7fb5-2fc8-4224-ace3-6bb6c5a1bd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770179f1-29fb-488f-88ba-88d6f0b1e7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (770179f1-29fb-488f-88ba-88d6f0b1e7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2072211361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2b5f50-70ef-4290-86d4-0a81523fb05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:54Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ac4bc4-67e8-43dc-bdb4-f3bdf75c7f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ac4bc4-67e8-43dc-bdb4-f3bdf75c7f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670411c5-e49b-42f9-b2f1-af3b8a7dbfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670411c5-e49b-42f9-b2f1-af3b8a7dbfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2b5f50-70ef-4290-86d4-0a81523fb05c', 'volume_name': 'volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434d7207-3543-42e4-a6d5-26dad6779f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434d7207-3543-42e4-a6d5-26dad6779f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bc1734-5264-467f-8670-7852ec79a795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume 8a2b5f50-70ef-4290-86d4-0a81523fb05c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c', 'volume_size': 1}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b 1073741824" returned: 0 in 0.546s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:54 devstack sudo[105827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b
Nov 05 04:33:54 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:54 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1558365500',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66a65ef3-8003-4f6e-967e-13ed5ea1f8e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:54Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Creating volume 66a65ef3-8003-4f6e-967e-13ed5ea1f8e5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:54 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b485098-2f05-4f6b-8e43-b4bc0cdf8a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5 1073741824
Nov 05 04:33:54 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cfb622-a55b-4ab4-8821-d1fcc19bff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b (0192203a-3300-4e3e-a7ac-e2ac88ef1e2b): created successfully
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2cfb622-a55b-4ab4-8821-d1fcc19bff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (8776cfd5-033e-48ae-b3d7-dca68938c5b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-53c85fbc-9a37-40f3-b257-fc96eba420a6 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created volume successfully.
Nov 05 04:33:55 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5 1073741824" returned: 0 in 0.413s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:55 devstack sudo[105836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5
Nov 05 04:33:55 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:55 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.336s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-659820037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79e27345-437e-412d-9afa-a91c20e41997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:54Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Creating volume 79e27345-437e-412d-9afa-a91c20e41997 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:55 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65754f34-0bea-4422-9e13-7878ed036d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:55 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997 1073741824
Nov 05 04:33:55 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c679f5aa-22ac-4051-8249-4e405ceb93f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5 (66a65ef3-8003-4f6e-967e-13ed5ea1f8e5): created successfully
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c679f5aa-22ac-4051-8249-4e405ceb93f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (2165a3a2-8da6-454f-9b6b-596fa91577db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-24d99d63-1e0e-49ef-a761-eb7a4dea3126 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created volume successfully.
Nov 05 04:33:56 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997 1073741824" returned: 0 in 0.426s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:56 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997
Nov 05 04:33:56 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:56 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.725s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2072211361',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2b5f50-70ef-4290-86d4-0a81523fb05c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2f5fd504874b489879d9ac83da1769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:33:54Z,use_quota=True,user_id='26f2220d39e14b259f71ebd4fd8fbb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Creating volume 8a2b5f50-70ef-4290-86d4-0a81523fb05c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:33:56 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd738ca-889a-4b54-ab08-06216fc7f776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e27345-437e-412d-9afa-a91c20e41997', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:56 devstack sudo[105847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c 1073741824
Nov 05 04:33:56 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cad88c-9085-4f19-83d5-4b8e6bf1df27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:56 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume volume-79e27345-437e-412d-9afa-a91c20e41997 (79e27345-437e-412d-9afa-a91c20e41997): created successfully
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cad88c-9085-4f19-83d5-4b8e6bf1df27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (8a9e863b-d70a-438b-bb40-c5f18d1b9aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8229c569-1674-4ad2-a24b-c238e531bfd3 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created volume successfully.
Nov 05 04:33:56 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c 1073741824" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:56 devstack sudo[105853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c
Nov 05 04:33:56 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:57 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1bc1734-5264-467f-8670-7852ec79a795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87459a1d-8eda-42b3-b8fd-dd9a3758d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:33:57 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Volume volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c (8a2b5f50-70ef-4290-86d4-0a81523fb05c): created successfully
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87459a1d-8eda-42b3-b8fd-dd9a3758d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Flow 'volume_create_manager' (90ca7fb5-2fc8-4224-ace3-6bb6c5a1bd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:33:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3b06729f-09b5-4b79-a1d3-688b69aaa5b1 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created volume successfully.
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-8a2b5f50-70ef-4290-86d4-0a81523fb05c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-8a2b5f50-70ef-4290-86d4-0a81523fb05c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-quobyte-8a2b5f50-70ef-4290-86d4-0a81523fb05c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-8a2b5f50-70ef-4290-86d4-0a81523fb05c" acquired by "delete_volume" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1635d2-4a5a-445b-b359-39dd76b2e032]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:58 devstack sudo[105856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c
Nov 05 04:33:58 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:58 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:58 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c
Nov 05 04:33:58 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:58 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8a2b5f50-70ef-4290-86d4-0a81523fb05c" returned: 0 in 0.239s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-8a2b5f50-70ef-4290-86d4-0a81523fb05c" released by "delete_volume" :: held 0.630s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created reservations ['687ff819-3203-4505-aec5-018903d1d5dc', '0dc136d2-f925-4716-8c26-b49a78391259', 'fd6ceb2a-8627-46c8-b30d-b073269bb698', '98ea70af-c940-4a1a-b0db-ac1be20abd1f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:58 devstack sudo[105864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:58 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:58 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.244s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:33:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Deleted volume successfully.
Nov 05 04:33:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-281162ba-098d-4238-856a-2684fb5e13cd tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-8a2b5f50-70ef-4290-86d4-0a81523fb05c-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-79e27345-437e-412d-9afa-a91c20e41997-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-79e27345-437e-412d-9afa-a91c20e41997-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-quobyte-79e27345-437e-412d-9afa-a91c20e41997" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-79e27345-437e-412d-9afa-a91c20e41997" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eabb8b-460b-49c6-99a3-95a7ac0f48ac]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:59 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997
Nov 05 04:33:59 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:59 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997" returned: 0 in 0.350s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:59 devstack sudo[105872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997
Nov 05 04:33:59 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:33:59 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79e27345-437e-412d-9afa-a91c20e41997" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-79e27345-437e-412d-9afa-a91c20e41997" released by "delete_volume" :: held 0.638s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created reservations ['d9f8cc3f-55a0-4ed7-b26c-93f8b42fdce4', '10f85d05-1c20-430e-adf0-f8ac52a56e71', '005e2fdf-6a37-40c6-a88b-a0d821865a47', '9c3b6e0e-00fd-4057-93db-d26d03b2c422'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:33:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:33:59 devstack sudo[105876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:33:59 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:00 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.239s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Deleted volume successfully.
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d13cbf6d-db33-42c6-ac78-efd6a29a9294 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-79e27345-437e-412d-9afa-a91c20e41997-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-quobyte-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a0e4cb-8424-4ebb-9d0c-dd69c2e2bcb8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:00 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5
Nov 05 04:34:00 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:00 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5" returned: 0 in 0.353s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:00 devstack sudo[105884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5
Nov 05 04:34:00 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:00 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5" released by "delete_volume" :: held 0.635s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:00 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created reservations ['e9250534-fdf3-478c-9989-b4381b854ff5', '21ab0b4c-f359-4d5b-8f63-ccf78ec8d7d3', '8c61c6c3-8b25-4d01-b0b1-26fcfd780a13', '1180fd7b-631d-43b2-aa9e-3b9f1194a5ad'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:01 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:01 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:01 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Deleted volume successfully.
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-92751995-faea-40e8-a7a9-ade0670902b2 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-66a65ef3-8003-4f6e-967e-13ed5ea1f8e5-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-quobyte-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b" acquired by "delete_volume" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[24071690-84b8-4dae-bdc7-64de15493c66]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:01 devstack sudo[105890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b
Nov 05 04:34:01 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:01 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b" returned: 0 in 0.354s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:01 devstack sudo[105895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b
Nov 05 04:34:01 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:02 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b" released by "delete_volume" :: held 0.633s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created reservations ['8eae9ac9-4dac-45f6-8558-d3d51d99b6aa', '4bb701ef-9503-4882-b71f-0c270c21abef', 'f3408be8-1936-41b5-9dab-8f49fcba4409', '5a4e6122-7f5f-4522-96ae-c324f4a4d3fa'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:02 devstack sudo[105898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:02 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:02 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.239s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Deleted volume successfully.
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-12f1cdc8-4ce5-4648-9ab1-b961ee4da64f tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-0192203a-3300-4e3e-a7ac-e2ac88ef1e2b-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-4550ea89-8133-4fcf-a918-6facb277e88f-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-4550ea89-8133-4fcf-a918-6facb277e88f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-quobyte-4550ea89-8133-4fcf-a918-6facb277e88f" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-4550ea89-8133-4fcf-a918-6facb277e88f" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e43645-2f7c-4368-ac67-a9cbe1749fe5]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:02 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f
Nov 05 04:34:02 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:02 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:03 devstack sudo[105906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f
Nov 05 04:34:03 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:03 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4550ea89-8133-4fcf-a918-6facb277e88f" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-4550ea89-8133-4fcf-a918-6facb277e88f" released by "delete_volume" :: held 0.637s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created reservations ['5052a5e9-4ffa-4757-a3cd-21b860bff1a3', '2ee18fba-22b4-48d3-9d4a-49b926c8fb0c', '4b74d05f-572f-4d4f-ab7f-70591addd879', '351748b3-1955-4816-8041-474082df7e2e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:03 devstack sudo[105909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:03 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:03 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.235s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Deleted volume successfully.
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-52531f1f-12da-4e57-a95a-fae8ef4e2750 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-4550ea89-8133-4fcf-a918-6facb277e88f-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-99d58eef-e788-46be-8acc-8ddcbcf66117-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-99d58eef-e788-46be-8acc-8ddcbcf66117-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "cinder-quobyte-99d58eef-e788-46be-8acc-8ddcbcf66117" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-99d58eef-e788-46be-8acc-8ddcbcf66117" acquired by "delete_volume" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5632d7b-ff5a-49dc-98a5-39d33934cf63]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:03 devstack sudo[105912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117
Nov 05 04:34:03 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:04 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117" returned: 0 in 0.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:04 devstack sudo[105917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117
Nov 05 04:34:04 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:04 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-99d58eef-e788-46be-8acc-8ddcbcf66117" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-quobyte-99d58eef-e788-46be-8acc-8ddcbcf66117" released by "delete_volume" :: held 0.646s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Created reservations ['e4b4b0c8-512a-4a3a-a7fa-bf1291531ed2', 'f11c0d94-e130-4a04-b43f-98d6eafed1e1', 'af9ab2de-9721-4765-bfef-9f18033cbbb7', 'a1e33456-bdfd-41b4-800a-9b15a5d4fd7d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:04 devstack sudo[105920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:04 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:04 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.236s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Deleted volume successfully.
Nov 05 04:34:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-76128482-2eb5-450e-b0ef-0826523d1226 tempest-CreateVolumesFromSourceVolumeTest-1124678216 None] Lock "cinder-99d58eef-e788-46be-8acc-8ddcbcf66117-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:07 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Flow 'volume_create_manager' (8b0cecdb-d67f-42b5-a82c-3928e553347c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece9e651-1657-4898-b737-a49412dbd35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece9e651-1657-4898-b737-a49412dbd35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676118076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd14e231-5f8d-4dff-95eb-2c9425b2a9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2638e5285444c69a4052b8340e0e1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:08Z,use_quota=True,user_id='2111427cb48540ea843f99df8af83efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda34ea0-89ef-4597-874f-25b5d70d24b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda34ea0-89ef-4597-874f-25b5d70d24b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcd9af3-4742-4992-a4a6-4877cd7ad725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abcd9af3-4742-4992-a4a6-4877cd7ad725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd14e231-5f8d-4dff-95eb-2c9425b2a9b4', 'volume_name': 'volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced89c11-621d-4b50-b7cb-eb6cf32bd253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced89c11-621d-4b50-b7cb-eb6cf32bd253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c79641-4781-41f6-8be1-7fc8d544e2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Volume fd14e231-5f8d-4dff-95eb-2c9425b2a9b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4', 'volume_size': 1}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1676118076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd14e231-5f8d-4dff-95eb-2c9425b2a9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2638e5285444c69a4052b8340e0e1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:08Z,use_quota=True,user_id='2111427cb48540ea843f99df8af83efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Creating volume fd14e231-5f8d-4dff-95eb-2c9425b2a9b4 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:08 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:08 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4 1073741824
Nov 05 04:34:08 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:08 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4 1073741824" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:08 devstack sudo[105928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4
Nov 05 04:34:08 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:08 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4" returned: 0 in 0.252s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c79641-4781-41f6-8be1-7fc8d544e2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a7028b-857d-4f8e-b6a0-d334e0e97381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:08 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Volume volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4 (fd14e231-5f8d-4dff-95eb-2c9425b2a9b4): created successfully
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a7028b-857d-4f8e-b6a0-d334e0e97381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:08 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Flow 'volume_create_manager' (8b0cecdb-d67f-42b5-a82c-3928e553347c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e83dff25-a05b-4028-8762-13546c9600a8 tempest-ProjectReaderTests-53293415 None] Created volume successfully.
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Acquiring lock "cinder-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Lock "cinder-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Acquiring lock "cinder-quobyte-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Lock "cinder-quobyte-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35ed4c7-9b18-421c-9445-492f02e43ad3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:09 devstack sudo[105931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4
Nov 05 04:34:09 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:09 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4" returned: 0 in 0.348s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:09 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4
Nov 05 04:34:09 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:09 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Lock "cinder-quobyte-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4" released by "delete_volume" :: held 0.638s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Created reservations ['615f0516-242e-488e-a040-99e41fb98e26', '9a2d59ed-6e15-48ea-a686-9e21e1c39ce2', '8708d820-538a-4f5b-b709-5adbf0234742', '69229020-4df5-4c1e-bcc9-2ac01ef8ab43'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:09 devstack sudo[105940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:09 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:10 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.234s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Deleted volume successfully.
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-25328b25-4c90-4308-a822-b29be5313243 tempest-ProjectReaderTests-53293415 None] Lock "cinder-fd14e231-5f8d-4dff-95eb-2c9425b2a9b4-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Flow 'volume_create_manager' (36bb6fdd-4e71-4a2e-9d31-ce61333b8cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05463d14-cc79-4a6f-9579-2fc026ce8fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05463d14-cc79-4a6f-9579-2fc026ce8fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2087733510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29965f6-bf79-445c-930b-ef5471ba95df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2638e5285444c69a4052b8340e0e1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:11Z,use_quota=True,user_id='2111427cb48540ea843f99df8af83efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77525462-51e7-4752-9acc-d83b8ba16658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77525462-51e7-4752-9acc-d83b8ba16658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ce509e-7d07-4149-85a6-0d2f1017649e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98ce509e-7d07-4149-85a6-0d2f1017649e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29965f6-bf79-445c-930b-ef5471ba95df', 'volume_name': 'volume-b29965f6-bf79-445c-930b-ef5471ba95df', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47eb864-dcfa-4e45-8df3-aa1042b50598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47eb864-dcfa-4e45-8df3-aa1042b50598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8fed1d1-2642-4399-b955-2eff0b033ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Volume b29965f6-bf79-445c-930b-ef5471ba95df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29965f6-bf79-445c-930b-ef5471ba95df', 'volume_size': 1}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2087733510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29965f6-bf79-445c-930b-ef5471ba95df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2638e5285444c69a4052b8340e0e1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:11Z,use_quota=True,user_id='2111427cb48540ea843f99df8af83efd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Creating volume b29965f6-bf79-445c-930b-ef5471ba95df {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:10 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:10 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df 1073741824
Nov 05 04:34:10 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:11 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df 1073741824" returned: 0 in 0.417s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:11 devstack sudo[105949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df
Nov 05 04:34:11 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:11 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8fed1d1-2642-4399-b955-2eff0b033ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29965f6-bf79-445c-930b-ef5471ba95df', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12937ee7-b3ee-4d20-a32b-c40a0874301d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Volume volume-b29965f6-bf79-445c-930b-ef5471ba95df (b29965f6-bf79-445c-930b-ef5471ba95df): created successfully
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12937ee7-b3ee-4d20-a32b-c40a0874301d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Flow 'volume_create_manager' (36bb6fdd-4e71-4a2e-9d31-ce61333b8cee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6be10923-a863-48a0-8742-8a0f44d057a1 tempest-ProjectReaderTests-53293415 None] Created volume successfully.
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Acquiring lock "cinder-b29965f6-bf79-445c-930b-ef5471ba95df-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Lock "cinder-b29965f6-bf79-445c-930b-ef5471ba95df-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Acquiring lock "cinder-quobyte-b29965f6-bf79-445c-930b-ef5471ba95df" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Lock "cinder-quobyte-b29965f6-bf79-445c-930b-ef5471ba95df" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc49f63b-c287-4986-874c-60af13b54612]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:11 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df
Nov 05 04:34:11 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:12 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df" returned: 0 in 0.349s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:12 devstack sudo[105958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df
Nov 05 04:34:12 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:12 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b29965f6-bf79-445c-930b-ef5471ba95df" returned: 0 in 0.237s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Lock "cinder-quobyte-b29965f6-bf79-445c-930b-ef5471ba95df" released by "delete_volume" :: held 0.632s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Created reservations ['5fa1653a-b35c-4a30-8bd1-1ffa155c0997', 'c369cca9-475f-44bd-a6cf-22605cc5f97e', '419999e7-77cf-4873-b75a-a4ca95c7cb96', 'ff7947c8-cb54-4f00-9bb5-94dcc99fdf0f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:12 devstack sudo[105961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:12 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:12 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.238s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Deleted volume successfully.
Nov 05 04:34:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a1adc7ce-6e40-4895-80f8-43d751a50e13 tempest-ProjectReaderTests-53293415 None] Lock "cinder-b29965f6-bf79-445c-930b-ef5471ba95df-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Flow 'volume_create_manager' (98ac2c8a-0baa-4d37-b161-ab4d8e581697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bc8849-0b4a-42a1-b351-576a6d227192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23bc8849-0b4a-42a1-b351-576a6d227192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17263748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140f0e0c-4fc2-4eb6-93c2-961f272a4275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7a32ff17574f81a722014b7fdbc56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:16Z,use_quota=True,user_id='dcc20ce3c2494f1484d8f80dd4f2d8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3622388d-3302-4af7-91ac-649d9089e8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3622388d-3302-4af7-91ac-649d9089e8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721ad2af-ffac-4002-bda2-5c5db8f5efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (721ad2af-ffac-4002-bda2-5c5db8f5efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '140f0e0c-4fc2-4eb6-93c2-961f272a4275', 'volume_name': 'volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b319e4-70eb-4037-a593-0425963f136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36b319e4-70eb-4037-a593-0425963f136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a76f13e-e6a8-434b-8bcd-9813b97722af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Volume 140f0e0c-4fc2-4eb6-93c2-961f272a4275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275', 'volume_size': 1}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17263748',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140f0e0c-4fc2-4eb6-93c2-961f272a4275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7a32ff17574f81a722014b7fdbc56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:16Z,use_quota=True,user_id='dcc20ce3c2494f1484d8f80dd4f2d8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Creating volume 140f0e0c-4fc2-4eb6-93c2-961f272a4275 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:16 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:16 devstack sudo[105966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275 1073741824
Nov 05 04:34:16 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:16 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275 1073741824" returned: 0 in 0.445s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:16 devstack sudo[105972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275
Nov 05 04:34:16 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:17 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a76f13e-e6a8-434b-8bcd-9813b97722af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b8e5ab-9176-4ade-91a0-efb591a742b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Volume volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275 (140f0e0c-4fc2-4eb6-93c2-961f272a4275): created successfully
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b8e5ab-9176-4ade-91a0-efb591a742b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Flow 'volume_create_manager' (98ac2c8a-0baa-4d37-b161-ab4d8e581697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a5a41f0f-575f-42fe-b090-2e99fbbf2550 tempest-ProjectReaderTests-2063212107 None] Created volume successfully.
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "cinder-140f0e0c-4fc2-4eb6-93c2-961f272a4275-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-140f0e0c-4fc2-4eb6-93c2-961f272a4275-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "cinder-quobyte-140f0e0c-4fc2-4eb6-93c2-961f272a4275" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-quobyte-140f0e0c-4fc2-4eb6-93c2-961f272a4275" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c466a-c806-4e79-87f6-9ad130074558]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:17 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275
Nov 05 04:34:17 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:17 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275" returned: 0 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:17 devstack sudo[105986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275
Nov 05 04:34:17 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:18 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-140f0e0c-4fc2-4eb6-93c2-961f272a4275" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-quobyte-140f0e0c-4fc2-4eb6-93c2-961f272a4275" released by "delete_volume" :: held 0.637s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Created reservations ['96918b51-a453-4a4b-aa9f-b7ab6449787a', '60ca62b9-32f3-4bd2-9d54-a1b07eeb1041', '7b1f211f-bae3-4cfd-adff-976c48349cb7', 'd0293d51-e73c-4c81-b003-cedae456cd35'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:18 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:18 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:18 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.238s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Deleted volume successfully.
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3dfb09ff-17bd-47fe-937b-b2850c40c434 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-140f0e0c-4fc2-4eb6-93c2-961f272a4275-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Flow 'volume_create_manager' (5e3bebdd-61a9-48ff-9864-85262aa76e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d95bf25-d42a-4840-b58d-735fe1a3015a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d95bf25-d42a-4840-b58d-735fe1a3015a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394738175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e310e95-ff91-49f0-8be1-02cc39433fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7a32ff17574f81a722014b7fdbc56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:19Z,use_quota=True,user_id='dcc20ce3c2494f1484d8f80dd4f2d8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b757870-4447-4a59-855f-3f5924a9563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b757870-4447-4a59-855f-3f5924a9563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710d649a-b58c-42fb-a388-49815ea92192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710d649a-b58c-42fb-a388-49815ea92192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e310e95-ff91-49f0-8be1-02cc39433fa0', 'volume_name': 'volume-0e310e95-ff91-49f0-8be1-02cc39433fa0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a5b6d7-36c8-4e16-9f04-b0b34ebb7d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a5b6d7-36c8-4e16-9f04-b0b34ebb7d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79a63b3-6e21-4b44-b3d2-1b9d7d6de235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Volume 0e310e95-ff91-49f0-8be1-02cc39433fa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e310e95-ff91-49f0-8be1-02cc39433fa0', 'volume_size': 1}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394738175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e310e95-ff91-49f0-8be1-02cc39433fa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7a32ff17574f81a722014b7fdbc56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:19Z,use_quota=True,user_id='dcc20ce3c2494f1484d8f80dd4f2d8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Creating volume 0e310e95-ff91-49f0-8be1-02cc39433fa0 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:19 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:19 devstack sudo[105992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0 1073741824
Nov 05 04:34:19 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:19 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0 1073741824" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:19 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0
Nov 05 04:34:19 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:19 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b79a63b3-6e21-4b44-b3d2-1b9d7d6de235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e310e95-ff91-49f0-8be1-02cc39433fa0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2d620f-deb7-48ae-9509-5928fe12c230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Volume volume-0e310e95-ff91-49f0-8be1-02cc39433fa0 (0e310e95-ff91-49f0-8be1-02cc39433fa0): created successfully
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2d620f-deb7-48ae-9509-5928fe12c230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Flow 'volume_create_manager' (5e3bebdd-61a9-48ff-9864-85262aa76e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c140af8d-4876-485f-833e-cf56fd845f93 tempest-ProjectReaderTests-2063212107 None] Created volume successfully.
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "cinder-0e310e95-ff91-49f0-8be1-02cc39433fa0-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-0e310e95-ff91-49f0-8be1-02cc39433fa0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "cinder-quobyte-0e310e95-ff91-49f0-8be1-02cc39433fa0" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-quobyte-0e310e95-ff91-49f0-8be1-02cc39433fa0" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a532fd67-1bbc-44ab-be0c-9658e70ecda3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:20 devstack sudo[106002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0
Nov 05 04:34:20 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:20 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0" returned: 0 in 0.358s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:20 devstack sudo[106007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0
Nov 05 04:34:20 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:20 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0e310e95-ff91-49f0-8be1-02cc39433fa0" returned: 0 in 0.248s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-quobyte-0e310e95-ff91-49f0-8be1-02cc39433fa0" released by "delete_volume" :: held 0.644s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Created reservations ['e0ec5d39-f07d-43b4-982b-7610a312cc37', '2a7e478b-90e9-44d8-b9dc-80898fdb984f', 'c856d2f1-dcb2-4d1e-abc3-3baa7910a2a4', 'e2fdb071-36c1-49b2-995d-9b26161a3107'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:20 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:20 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:21 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.244s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Deleted volume successfully.
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dc9f0d36-8fe1-40be-8c20-423e3cbc92c5 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-0e310e95-ff91-49f0-8be1-02cc39433fa0-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Flow 'volume_create_manager' (1a76dabb-044e-4402-8863-56f677694cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9218ea2-7373-4efc-9929-6f8e2e549dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9218ea2-7373-4efc-9929-6f8e2e549dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887410838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46650ed-041a-42ad-8072-213600e80a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7a32ff17574f81a722014b7fdbc56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:22Z,use_quota=True,user_id='dcc20ce3c2494f1484d8f80dd4f2d8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5188bc48-37a2-4c28-9d6c-b87e5ae3a77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5188bc48-37a2-4c28-9d6c-b87e5ae3a77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004c85c7-a037-4dd5-8141-f1c5656e5154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004c85c7-a037-4dd5-8141-f1c5656e5154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e46650ed-041a-42ad-8072-213600e80a3b', 'volume_name': 'volume-e46650ed-041a-42ad-8072-213600e80a3b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37125b6-cd50-4bc3-9687-585b64de2b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37125b6-cd50-4bc3-9687-585b64de2b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d6e1cf-7354-42d8-89a7-a9ec159e1160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Volume e46650ed-041a-42ad-8072-213600e80a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e46650ed-041a-42ad-8072-213600e80a3b', 'volume_size': 1}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887410838',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46650ed-041a-42ad-8072-213600e80a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7a32ff17574f81a722014b7fdbc56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:22Z,use_quota=True,user_id='dcc20ce3c2494f1484d8f80dd4f2d8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Creating volume e46650ed-041a-42ad-8072-213600e80a3b {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:21 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:21 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b 1073741824
Nov 05 04:34:21 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:22 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b 1073741824" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:22 devstack sudo[106019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b
Nov 05 04:34:22 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:22 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d6e1cf-7354-42d8-89a7-a9ec159e1160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46650ed-041a-42ad-8072-213600e80a3b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4916b78-e5ae-43ff-87e4-0c64f89b666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:22 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Volume volume-e46650ed-041a-42ad-8072-213600e80a3b (e46650ed-041a-42ad-8072-213600e80a3b): created successfully
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4916b78-e5ae-43ff-87e4-0c64f89b666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Flow 'volume_create_manager' (1a76dabb-044e-4402-8863-56f677694cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-406ad9ad-88be-4fd8-8c3e-e4f200410d22 tempest-ProjectReaderTests-2063212107 None] Created volume successfully.
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Acquiring lock "cinder-e46650ed-041a-42ad-8072-213600e80a3b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Lock "cinder-e46650ed-041a-42ad-8072-213600e80a3b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Acquiring lock "cinder-quobyte-e46650ed-041a-42ad-8072-213600e80a3b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Lock "cinder-quobyte-e46650ed-041a-42ad-8072-213600e80a3b" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[539fb92d-2836-4e25-91c2-fa6d508a35ba]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:22 devstack sudo[106022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b
Nov 05 04:34:22 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:23 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b" returned: 0 in 0.354s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:23 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b
Nov 05 04:34:23 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:23 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e46650ed-041a-42ad-8072-213600e80a3b" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Lock "cinder-quobyte-e46650ed-041a-42ad-8072-213600e80a3b" released by "delete_volume" :: held 0.633s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Created reservations ['cb89daa4-d765-4da6-ac9a-7649e5f7227c', 'e0a78869-23f8-48f4-b06d-444d743da487', '1ab3ef5f-8bf4-4c6a-a635-0ce6485b9afd', 'ed6334da-9d65-4fdc-82ee-4ad6b8bcef56'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:23 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:23 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:23 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Deleted volume successfully.
Nov 05 04:34:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3375a0d2-77c1-4273-8f5d-b103f372e49c tempest-ProjectReaderTests-2063212107 None] Lock "cinder-e46650ed-041a-42ad-8072-213600e80a3b-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Flow 'volume_create_manager' (50f98f6b-30ef-4787-a302-048a41ed3638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4fc72a-e773-4e42-9f08-9e46a2d5c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4fc72a-e773-4e42-9f08-9e46a2d5c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366270267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73144693-4954-4eba-9a8b-ffde427257b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7a32ff17574f81a722014b7fdbc56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:24Z,use_quota=True,user_id='dcc20ce3c2494f1484d8f80dd4f2d8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4b9283-c2b1-4997-982b-ef308a33cfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4b9283-c2b1-4997-982b-ef308a33cfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa60d24-4f64-4aa4-babc-6335e7dc3ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa60d24-4f64-4aa4-babc-6335e7dc3ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73144693-4954-4eba-9a8b-ffde427257b7', 'volume_name': 'volume-73144693-4954-4eba-9a8b-ffde427257b7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263db41b-1788-4c2f-b93b-c7dc3269ed6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (263db41b-1788-4c2f-b93b-c7dc3269ed6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9679adf-eacc-48ab-9095-a260dc185eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:24 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Volume 73144693-4954-4eba-9a8b-ffde427257b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73144693-4954-4eba-9a8b-ffde427257b7', 'volume_size': 1}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1366270267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73144693-4954-4eba-9a8b-ffde427257b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb7a32ff17574f81a722014b7fdbc56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:24Z,use_quota=True,user_id='dcc20ce3c2494f1484d8f80dd4f2d8c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Creating volume 73144693-4954-4eba-9a8b-ffde427257b7 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:24 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:24 devstack sudo[106033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7 1073741824
Nov 05 04:34:24 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:24 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7 1073741824" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:24 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7
Nov 05 04:34:24 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:25 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9679adf-eacc-48ab-9095-a260dc185eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73144693-4954-4eba-9a8b-ffde427257b7', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee9cd15-1e97-4179-a1ab-f8ec99811a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:25 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Volume volume-73144693-4954-4eba-9a8b-ffde427257b7 (73144693-4954-4eba-9a8b-ffde427257b7): created successfully
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee9cd15-1e97-4179-a1ab-f8ec99811a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Flow 'volume_create_manager' (50f98f6b-30ef-4787-a302-048a41ed3638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6ee4c6dc-c362-4ff8-82ef-375a497b354a tempest-ProjectReaderTests-2063212107 None] Created volume successfully.
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "cinder-73144693-4954-4eba-9a8b-ffde427257b7-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-73144693-4954-4eba-9a8b-ffde427257b7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "cinder-quobyte-73144693-4954-4eba-9a8b-ffde427257b7" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-quobyte-73144693-4954-4eba-9a8b-ffde427257b7" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[bada3e16-bdca-4781-a2df-94428b75e6b0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:25 devstack sudo[106041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7
Nov 05 04:34:25 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:25 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:25 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7
Nov 05 04:34:25 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:25 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73144693-4954-4eba-9a8b-ffde427257b7" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-quobyte-73144693-4954-4eba-9a8b-ffde427257b7" released by "delete_volume" :: held 0.647s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Created reservations ['fc52120b-ab70-4ded-99ec-b1fd72f9c20c', '6df52f5f-784c-41bf-8585-2430b545934d', 'a151acf9-183d-4af5-81e6-c03f06555ebe', '9ca78d11-044f-4eb0-a964-fddb39e8d79a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:26 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:26 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:26 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.238s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Deleted volume successfully.
Nov 05 04:34:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-68ae8f42-ee7c-47b8-b7ed-e33f0bd1ed42 tempest-ProjectReaderTests-2063212107 None] Lock "cinder-73144693-4954-4eba-9a8b-ffde427257b7-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:29 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:29 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:29 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:34:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:34:36 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:UPDATE=189,cinder:SELECT=120,cinder:INSERT=46,cinder:DELETE=15 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:34:36 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=119,cinder:UPDATE=186,cinder:DELETE=19,cinder:INSERT=39 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (0d09a1d9-3edc-43f3-8767-92cdf0c82ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e16053-9f40-4660-ab89-b33bd0d55747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e16053-9f40-4660-ab89-b33bd0d55747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-78139916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691163be-938b-47f8-bb6a-fdb18a9415ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:39Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f45edb98-54d3-43b4-abaa-49635109ff94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f45edb98-54d3-43b4-abaa-49635109ff94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c82346-5c88-4930-87c5-7260df55a883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c82346-5c88-4930-87c5-7260df55a883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691163be-938b-47f8-bb6a-fdb18a9415ce', 'volume_name': 'volume-691163be-938b-47f8-bb6a-fdb18a9415ce', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42cff57-a4e3-4e13-bc8e-0f42167d6b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42cff57-a4e3-4e13-bc8e-0f42167d6b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a4db70-92e7-49b4-9b69-6c4650723866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume 691163be-938b-47f8-bb6a-fdb18a9415ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691163be-938b-47f8-bb6a-fdb18a9415ce', 'volume_size': 1}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-78139916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691163be-938b-47f8-bb6a-fdb18a9415ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:39Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Creating volume 691163be-938b-47f8-bb6a-fdb18a9415ce {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:38 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:38 devstack sudo[106130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce 1073741824
Nov 05 04:34:38 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Flow 'volume_create_manager' (2afcb158-997d-400d-b47c-20ba9e674444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb717952-b4e2-4a72-9c67-04e52be1e62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb717952-b4e2-4a72-9c67-04e52be1e62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24280bb-2436-45e4-96c7-4fd292c1b7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b833226db8043aeaabfc3bbe0b13e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:39Z,use_quota=True,user_id='911015c51f164137ac17e11cd8f00f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597dbf44-e55f-4e94-8684-83176d33b25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (597dbf44-e55f-4e94-8684-83176d33b25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301b6e1a-9f89-40d8-aa5c-d66a7bc87ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (301b6e1a-9f89-40d8-aa5c-d66a7bc87ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24280bb-2436-45e4-96c7-4fd292c1b7f2', 'volume_name': 'volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02179d44-d2ac-4568-a6aa-9fb8df19b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02179d44-d2ac-4568-a6aa-9fb8df19b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d02a9e9-9d01-4a78-af37-0aaa2112daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Volume c24280bb-2436-45e4-96c7-4fd292c1b7f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2', 'volume_size': 1}
Nov 05 04:34:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:39 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce 1073741824" returned: 0 in 0.541s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:39 devstack sudo[106136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce
Nov 05 04:34:39 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:39 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce" returned: 0 in 0.335s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.730s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24280bb-2436-45e4-96c7-4fd292c1b7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b833226db8043aeaabfc3bbe0b13e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:39Z,use_quota=True,user_id='911015c51f164137ac17e11cd8f00f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Creating volume c24280bb-2436-45e4-96c7-4fd292c1b7f2 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:39 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:39 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2 1073741824
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a4db70-92e7-49b4-9b69-6c4650723866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691163be-938b-47f8-bb6a-fdb18a9415ce', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:39 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a93685-b851-4dea-abad-50bc17ab8cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume volume-691163be-938b-47f8-bb6a-fdb18a9415ce (691163be-938b-47f8-bb6a-fdb18a9415ce): created successfully
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6a93685-b851-4dea-abad-50bc17ab8cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (0d09a1d9-3edc-43f3-8767-92cdf0c82ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4d56ed3d-6a6e-4507-adcb-1918e8484c8d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created volume successfully.
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (b03ed489-2f55-4e71-a07b-378ce511fa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2733029-fcb6-4dc6-a1ff-bf53f13b47fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2733029-fcb6-4dc6-a1ff-bf53f13b47fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678517959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c975e0-3899-4816-aa1b-e61213c050e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:40Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebaebada-7e68-4472-b028-4571bf121067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebaebada-7e68-4472-b028-4571bf121067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f58924-9c38-4a68-bde6-ab3517110013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7f58924-9c38-4a68-bde6-ab3517110013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c975e0-3899-4816-aa1b-e61213c050e5', 'volume_name': 'volume-a2c975e0-3899-4816-aa1b-e61213c050e5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712261a8-08e2-46bf-959f-696503706516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (712261a8-08e2-46bf-959f-696503706516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47de3462-f4e6-49a0-b0fc-680014148fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Volume a2c975e0-3899-4816-aa1b-e61213c050e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c975e0-3899-4816-aa1b-e61213c050e5', 'volume_size': 1}
Nov 05 04:34:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:40 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2 1073741824" returned: 0 in 0.510s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:40 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2
Nov 05 04:34:40 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:40 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.603s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-678517959',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c975e0-3899-4816-aa1b-e61213c050e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:40Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Creating volume a2c975e0-3899-4816-aa1b-e61213c050e5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:40 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:40 devstack sudo[106149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5 1073741824
Nov 05 04:34:40 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d02a9e9-9d01-4a78-af37-0aaa2112daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5d1ce3-0dfd-4d47-b6ff-baf6fc7ad928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:40 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Volume volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2 (c24280bb-2436-45e4-96c7-4fd292c1b7f2): created successfully
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5d1ce3-0dfd-4d47-b6ff-baf6fc7ad928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Flow 'volume_create_manager' (2afcb158-997d-400d-b47c-20ba9e674444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-44ae3e0e-a67d-4e90-966d-8ebe3bca695d tempest-CinderUnicodeTest-601077571 None] Created volume successfully.
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:40 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5 1073741824" returned: 0 in 0.517s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:41 devstack sudo[106155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5
Nov 05 04:34:41 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:41 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.489s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47de3462-f4e6-49a0-b0fc-680014148fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c975e0-3899-4816-aa1b-e61213c050e5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5678977-0b40-4260-9ed3-14d4aba72ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Creating offline snapshot fe8f96db-278c-4f71-bc84-fc8e3956e403 of volume 691163be-938b-47f8-bb6a-fdb18a9415ce {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[000742f2-932f-4ba9-b309-19a9eeb9d14c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Volume volume-a2c975e0-3899-4816-aa1b-e61213c050e5 (a2c975e0-3899-4816-aa1b-e61213c050e5): created successfully
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5678977-0b40-4260-9ed3-14d4aba72ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (b03ed489-2f55-4e71-a07b-378ce511fa25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:41 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-51c7a357-0597-4601-9301-811bf3f0d6b0 tempest-ProjectReaderTests-849464089 None] Created volume successfully.
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Flow 'volume_create_manager' (03d5a865-0530-412f-9e8e-a0ab1a1603bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb439c68-9281-4784-ac24-2d9414aac3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb439c68-9281-4784-ac24-2d9414aac3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1041263286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afff7523-3ed8-4430-9c39-a72b2b5fd443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b833226db8043aeaabfc3bbe0b13e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:41Z,use_quota=True,user_id='911015c51f164137ac17e11cd8f00f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd63ba9c-0f6e-4066-8233-59b8e03e5071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd63ba9c-0f6e-4066-8233-59b8e03e5071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd8315d-fa59-4a05-936d-9823da024550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd8315d-fa59-4a05-936d-9823da024550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afff7523-3ed8-4430-9c39-a72b2b5fd443', 'volume_name': 'volume-afff7523-3ed8-4430-9c39-a72b2b5fd443', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d151d71-3c81-47a2-978c-3f6646d3c0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:41 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce
Nov 05 04:34:41 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d151d71-3c81-47a2-978c-3f6646d3c0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f59ff7-1b53-45b9-80a9-20dd986445da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:41 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Volume afff7523-3ed8-4430-9c39-a72b2b5fd443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afff7523-3ed8-4430-9c39-a72b2b5fd443', 'volume_size': 1}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:41 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:41 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 1G
Nov 05 04:34:41 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:42 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 1G" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691163be-938b-47f8-bb6a-fdb18a9415ce -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:42 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691163be-938b-47f8-bb6a-fdb18a9415ce -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403
Nov 05 04:34:42 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:42 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-691163be-938b-47f8-bb6a-fdb18a9415ce -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403" returned: 0 in 0.328s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:42 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 is being set with open permissions: ugo+rw
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:42 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403
Nov 05 04:34:42 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Flow 'volume_create_manager' (ad4eb0b4-08b0-4d1b-bc78-bb735267b8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8052c4-ad92-4960-96fe-f5b091a84e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8052c4-ad92-4960-96fe-f5b091a84e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73bca134-c077-48ca-a074-184c688ddf95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6659daf0a145fdbd4131a82139b096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:43Z,use_quota=True,user_id='2b9127348e7a4187a51c606e5bd83ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3ff2160-f0e0-44cb-8b1c-a0e53882d2a9),volume_type_id=b3ff2160-f0e0-44cb-8b1c-a0e53882d2a9)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4149a887-bbdd-4ddd-af10-20bf999f42d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4149a887-bbdd-4ddd-af10-20bf999f42d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ece1824-788a-4d02-9bd9-9acd8eccf514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:34:42 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403" returned: 0 in 0.262s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:42 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.info
Nov 05 04:34:42 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ece1824-788a-4d02-9bd9-9acd8eccf514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73bca134-c077-48ca-a074-184c688ddf95', 'volume_name': 'volume-73bca134-c077-48ca-a074-184c688ddf95', 'volume_size': 1, 'image_id': '7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8cbc4e61d92a3050b6aaa495f081e5e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f6659daf0a145fdbd4131a82139b096', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22077d84ae50f0ea8d2e336933e31ca16e35626b31659f2e9adbcdf5e13bd2183e152cd68d057cb0b465785f0dab27a3b825e01ced667fa0acc0f26c198f9428', 'id': '7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'created_at': datetime.datetime(2026, 11, 5, 3, 34, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 34, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c12ff18-d526-4c8b-bf24-2011ed9fbc4c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f228ad50>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d848099-75b7-40e0-bfab-0e0c9a55f4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d848099-75b7-40e0-bfab-0e0c9a55f4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa160b10-4e27-4f6f-bd94-25d324c62b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:43 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Volume 73bca134-c077-48ca-a074-184c688ddf95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73bca134-c077-48ca-a074-184c688ddf95', 'volume_size': 1, 'image_id': '7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8cbc4e61d92a3050b6aaa495f081e5e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f6659daf0a145fdbd4131a82139b096', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22077d84ae50f0ea8d2e336933e31ca16e35626b31659f2e9adbcdf5e13bd2183e152cd68d057cb0b465785f0dab27a3b825e01ced667fa0acc0f26c198f9428', 'id': '7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'created_at': datetime.datetime(2026, 11, 5, 3, 34, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 34, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c12ff18-d526-4c8b-bf24-2011ed9fbc4c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f228ad50>}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Trying to clone 73bca134-c077-48ca-a074-184c688ddf95 from image 7c12ff18-d526-4c8b-bf24-2011ed9fbc4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:34:43 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.info" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:43 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.info is being set with open permissions: ugo+rw
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:43 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.info
Nov 05 04:34:43 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:34:43 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77d12a1-93a4-4d3b-aab8-4277ade6532b]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:43 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD
Nov 05 04:34:43 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:43 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.info" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.896s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1041263286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afff7523-3ed8-4430-9c39-a72b2b5fd443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b833226db8043aeaabfc3bbe0b13e42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:41Z,use_quota=True,user_id='911015c51f164137ac17e11cd8f00f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Creating volume afff7523-3ed8-4430-9c39-a72b2b5fd443 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:43 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:43 devstack sudo[106186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 1073741824
Nov 05 04:34:43 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-780b598a-4cff-4064-be1f-3291b119395a tempest-CreateVolumesFromSnapshotTest-1689423764 None] Create snapshot completed successfully
Nov 05 04:34:43 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:43 devstack sudo[106190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD
Nov 05 04:34:43 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:43 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 1073741824" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:43 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Temporary image 7c12ff18-d526-4c8b-bf24-2011ed9fbc4c is fetched for user 2b9127348e7a4187a51c606e5bd83ea4. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:34:43 devstack sudo[106198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443
Nov 05 04:34:43 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[982125ed-170f-4a30-b131-267571436c18]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:44 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD
Nov 05 04:34:44 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:44 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.103s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47f59ff7-1b53-45b9-80a9-20dd986445da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afff7523-3ed8-4430-9c39-a72b2b5fd443', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69074b99-cab2-4b8d-8b91-4a20ad6a4c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Creating offline snapshot 8efc84af-c542-4078-84d6-a233d8897519 of volume a2c975e0-3899-4816-aa1b-e61213c050e5 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:34:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Volume volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 (afff7523-3ed8-4430-9c39-a72b2b5fd443): created successfully
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69074b99-cab2-4b8d-8b91-4a20ad6a4c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Flow 'volume_create_manager' (03d5a865-0530-412f-9e8e-a0ab1a1603bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a645a6a-7196-4d7c-a439-a2e34800f485]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:44 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-95923cbd-a12d-4d10-81b2-0f7a37532824 tempest-CinderUnicodeTest-601077571 None] Created volume successfully.
Nov 05 04:34:44 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:44 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5
Nov 05 04:34:44 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:44 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD
Nov 05 04:34:44 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (4ecf8f34-9232-4c6b-9996-de4ee12892b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7720f30-4ff7-483c-9a3d-def4b5ebd06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7720f30-4ff7-483c-9a3d-def4b5ebd06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1898717459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c00f29-db45-49f8-a582-d6b0160a8679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:44Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb3f0a6-cb0c-432d-9d0b-b9270af3c699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb3f0a6-cb0c-432d-9d0b-b9270af3c699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d09c32-facd-4a31-8166-9f775408eca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d09c32-facd-4a31-8166-9f775408eca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c00f29-db45-49f8-a582-d6b0160a8679', 'volume_name': 'volume-42c00f29-db45-49f8-a582-d6b0160a8679', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73acf83-3beb-471b-8a43-d6f4f37b6ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73acf83-3beb-471b-8a43-d6f4f37b6ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842864d6-fd14-4142-97f3-503574fe8465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:44 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume 42c00f29-db45-49f8-a582-d6b0160a8679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c00f29-db45-49f8-a582-d6b0160a8679', 'volume_size': 1}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:44 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:44 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5" returned: 0 in 0.582s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:44 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 1G
Nov 05 04:34:44 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (b4b40a2a-7f8d-4211-b6d1-8311287f9716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44477bf-f70d-4b1d-ac50-730810276884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e44477bf-f70d-4b1d-ac50-730810276884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-610471065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08bd29e-778d-40a4-8b78-fb7204cedfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:45Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158b40ac-e93b-43a4-85e4-4ee6672f2ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158b40ac-e93b-43a4-85e4-4ee6672f2ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f136b9d9-9d99-4543-b8dd-a26082552c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f136b9d9-9d99-4543-b8dd-a26082552c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f08bd29e-778d-40a4-8b78-fb7204cedfe3', 'volume_name': 'volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb86fda-0783-4a8d-be99-66124b4dfc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb86fda-0783-4a8d-be99-66124b4dfc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d25313-3d38-40c1-b818-cb8d9db898c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume f08bd29e-778d-40a4-8b78-fb7204cedfe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3', 'volume_size': 1}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:45 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 1G" returned: 0 in 0.490s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c975e0-3899-4816-aa1b-e61213c050e5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:45 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c975e0-3899-4816-aa1b-e61213c050e5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519
Nov 05 04:34:45 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (4df522a0-d4a1-4e84-bcc9-1430f4d24e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7996899-145c-4035-915b-79cff762e4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7996899-145c-4035-915b-79cff762e4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919978282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9cfdf5-feb1-45a0-ae28-42d669609330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:45Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14351b13-9d08-4a22-a0be-665deb0563d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14351b13-9d08-4a22-a0be-665deb0563d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79ed08b-1685-4397-a068-4320d74cfb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e79ed08b-1685-4397-a068-4320d74cfb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9cfdf5-feb1-45a0-ae28-42d669609330', 'volume_name': 'volume-9d9cfdf5-feb1-45a0-ae28-42d669609330', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58d5fcf-52c0-4ce1-b2b5-334afaf39a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58d5fcf-52c0-4ce1-b2b5-334afaf39a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70bf00a-aa82-4b78-a3ff-2a2023cc4f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume 9d9cfdf5-feb1-45a0-ae28-42d669609330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9cfdf5-feb1-45a0-ae28-42d669609330', 'volume_size': 1}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:45 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2c975e0-3899-4816-aa1b-e61213c050e5 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519" returned: 0 in 0.342s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:45 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 is being set with open permissions: ugo+rw
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:45 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519
Nov 05 04:34:45 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (bdab191d-01a2-450c-893a-96094b61065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f95e807-9e11-466a-9ffd-8dee059bf7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f95e807-9e11-466a-9ffd-8dee059bf7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1456317563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f2c86c-0190-489f-9629-b74c2d0e0716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:46Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef19e792-67e0-4372-b8b1-0a5a033f9d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef19e792-67e0-4372-b8b1-0a5a033f9d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720918ad-4d06-4962-8091-534f33480f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720918ad-4d06-4962-8091-534f33480f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f2c86c-0190-489f-9629-b74c2d0e0716', 'volume_name': 'volume-36f2c86c-0190-489f-9629-b74c2d0e0716', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f5958a-2c73-42b4-8700-fd6e237b8a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f5958a-2c73-42b4-8700-fd6e237b8a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30799c8f-8da3-43eb-bb9d-62d44915a13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume 36f2c86c-0190-489f-9629-b74c2d0e0716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f2c86c-0190-489f-9629-b74c2d0e0716', 'volume_size': 1}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:45 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:46 devstack sudo[106230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.info
Nov 05 04:34:46 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (9f353483-67cf-4743-90aa-31b7ae99904f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b17e3c5-f510-4406-a412-fd26d9d97080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b17e3c5-f510-4406-a412-fd26d9d97080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834195625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:46Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:46 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a118cd7a-062b-468c-801c-97f9fb0cd7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a118cd7a-062b-468c-801c-97f9fb0cd7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef574b0-ab22-49dc-b9fe-53ca633a8c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef574b0-ab22-49dc-b9fe-53ca633a8c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78', 'volume_name': 'volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7894dba6-f59d-4685-8ce7-34273702150a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7894dba6-f59d-4685-8ce7-34273702150a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1538c8a-ca46-4343-a966-fa8eb36e2172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:46 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume 91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78', 'volume_size': 1}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.info" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:46 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.info is being set with open permissions: ugo+rw
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:46 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.info
Nov 05 04:34:46 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:46 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.info" returned: 0 in 0.238s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1898717459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c00f29-db45-49f8-a582-d6b0160a8679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:44Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Creating volume 42c00f29-db45-49f8-a582-d6b0160a8679 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:46 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:46 devstack sudo[106236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679 1073741824
Nov 05 04:34:46 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-421c56e6-114a-41db-9af4-c3f394bc0ceb tempest-ProjectReaderTests-849464089 None] Create snapshot completed successfully
Nov 05 04:34:46 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679 1073741824" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:47 devstack sudo[106241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679
Nov 05 04:34:47 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:47 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.443s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73bca134-c077-48ca-a074-184c688ddf95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f6659daf0a145fdbd4131a82139b096',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:43Z,use_quota=True,user_id='2b9127348e7a4187a51c606e5bd83ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3ff2160-f0e0-44cb-8b1c-a0e53882d2a9),volume_type_id=b3ff2160-f0e0-44cb-8b1c-a0e53882d2a9)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Creating volume 73bca134-c077-48ca-a074-184c688ddf95 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:47 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842864d6-fd14-4142-97f3-503574fe8465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c00f29-db45-49f8-a582-d6b0160a8679', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:47 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 1073741824
Nov 05 04:34:47 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02b7a97-9c95-4e37-9299-b3883b4fbb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:47 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume volume-42c00f29-db45-49f8-a582-d6b0160a8679 (42c00f29-db45-49f8-a582-d6b0160a8679): created successfully
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02b7a97-9c95-4e37-9299-b3883b4fbb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (4ecf8f34-9232-4c6b-9996-de4ee12892b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6940f0c0-a662-4d92-bff1-d4af7b4c19a9 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created volume successfully.
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-8efc84af-c542-4078-84d6-a233d8897519-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Lock "cinder-8efc84af-c542-4078-84d6-a233d8897519-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-a2c975e0-3899-4816-aa1b-e61213c050e5" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-a2c975e0-3899-4816-aa1b-e61213c050e5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-8efc84af-c542-4078-84d6-a233d8897519" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-8efc84af-c542-4078-84d6-a233d8897519" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Deleting offline snapshot 8efc84af-c542-4078-84d6-a233d8897519 of volume a2c975e0-3899-4816-aa1b-e61213c050e5 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] snapshot_file for this snap is: volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ded687-5582-497e-853a-bb45d689843a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:47 devstack sudo[106249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519
Nov 05 04:34:47 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:47 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 1073741824" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:47 devstack sudo[106251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95
Nov 05 04:34:47 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:47 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2c975e0-3899-4816-aa1b-e61213c050e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[574ea066-d35e-4f2a-a233-7b3c2d8eed8a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:48 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.921s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Creating offline snapshot a1dec866-261d-4437-a2c1-f972ac12e4c8 of volume afff7523-3ed8-4430-9c39-a72b2b5fd443 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:34:48 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5
Nov 05 04:34:48 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Attempting download of 7c12ff18-d526-4c8b-bf24-2011ed9fbc4c ((None, [{'url': 'file:///opt/stack/data/glance/images/7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'metadata': {}}])) to volume 73bca134-c077-48ca-a074-184c688ddf95. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b412cf7f-fa8a-4de8-a5bd-61db6c98da6c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2096ff-d88d-4bc5-8649-4a6a36dfb6d1]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_r10gn4tj {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:48 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443
Nov 05 04:34:48 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:48 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_r10gn4tj
Nov 05 04:34:48 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:48 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5" returned: 0 in 0.371s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:48 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519
Nov 05 04:34:48 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:48 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_r10gn4tj" returned: 0 in 0.352s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_r10gn4tj {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:48 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443" returned: 0 in 0.428s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:48 devstack sudo[106275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 1G
Nov 05 04:34:48 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:48 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_r10gn4tj
Nov 05 04:34:48 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:48 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519" returned: 0 in 0.369s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:48 devstack sudo[106282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519
Nov 05 04:34:48 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:48 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_r10gn4tj" returned: 1 in 0.358s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_r10gn4tj' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75aa36e-0336-4b26-a892-e85a1eecd015]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:48 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 1G" returned: 0 in 0.446s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:48 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:48 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD
Nov 05 04:34:48 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5.8efc84af-c542-4078-84d6-a233d8897519" returned: 0 in 0.280s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:49 devstack sudo[106292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8
Nov 05 04:34:49 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-8efc84af-c542-4078-84d6-a233d8897519" released by "_delete_snapshot" :: held 1.555s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-a2c975e0-3899-4816-aa1b-e61213c050e5" released by "delete_snapshot" :: held 1.579s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Created reservations ['07824727-f3a3-4bd1-a29d-891db066c1f1', 'b9e62d3d-2059-4a8d-9c8e-893403f3b9a9', 'e05f258d-5caa-4061-8e07-9117700d8585', '1e54a046-7147-4f1d-8df7-6998190d34fb'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Delete snapshot completed successfully.
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6e4a4659-3103-41b3-81d5-1ac8d58ec126 tempest-ProjectReaderTests-849464089 None] Lock "cinder-8efc84af-c542-4078-84d6-a233d8897519-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:49 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:49 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8" returned: 0 in 0.320s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:49 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 is being set with open permissions: ugo+rw
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:49 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8
Nov 05 04:34:49 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:49 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD
Nov 05 04:34:49 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:49 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:49 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] 7c12ff18-d526-4c8b-bf24-2011ed9fbc4c was raw, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:49 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95
Nov 05 04:34:49 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-a2c975e0-3899-4816-aa1b-e61213c050e5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Lock "cinder-a2c975e0-3899-4816-aa1b-e61213c050e5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:49 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.info
Nov 05 04:34:49 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-a2c975e0-3899-4816-aa1b-e61213c050e5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-a2c975e0-3899-4816-aa1b-e61213c050e5" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd7345c-ebe4-4505-a3c9-8c010d10bf4d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:49 devstack sudo[106313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5
Nov 05 04:34:49 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:49 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.info" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:49 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.info is being set with open permissions: ugo+rw
Nov 05 04:34:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:49 devstack sudo[106320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.info
Nov 05 04:34:49 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:50 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95" returned: 0 in 0.494s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7c12ff18-d526-4c8b-bf24-2011ed9fbc4c_yh8vao9vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:34:50 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:50 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 1G
Nov 05 04:34:50 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:50 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5" returned: 0 in 0.423s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:50 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5
Nov 05 04:34:50 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:50 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.info" returned: 0 in 0.303s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.070s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-610471065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08bd29e-778d-40a4-8b78-fb7204cedfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:45Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Creating volume f08bd29e-778d-40a4-8b78-fb7204cedfe3 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:50 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:50 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3 1073741824
Nov 05 04:34:50 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6a209b04-5068-4fb1-90d2-57a93b517919 tempest-CinderUnicodeTest-601077571 None] Create snapshot completed successfully
Nov 05 04:34:50 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a2c975e0-3899-4816-aa1b-e61213c050e5" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:50 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 1G" returned: 0 in 0.400s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Downloaded image 7c12ff18-d526-4c8b-bf24-2011ed9fbc4c ((None, [{'url': 'file:///opt/stack/data/glance/images/7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'metadata': {}}])) to volume 73bca134-c077-48ca-a074-184c688ddf95 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Temporary image 7c12ff18-d526-4c8b-bf24-2011ed9fbc4c for user 2b9127348e7a4187a51c606e5bd83ea4 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Marking volume 73bca134-c077-48ca-a074-184c688ddf95 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-a2c975e0-3899-4816-aa1b-e61213c050e5" released by "delete_volume" :: held 0.775s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Copying metadata from image 7c12ff18-d526-4c8b-bf24-2011ed9fbc4c to 73bca134-c077-48ca-a074-184c688ddf95. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Creating volume glance metadata for volume 73bca134-c077-48ca-a074-184c688ddf95 backed by image 7c12ff18-d526-4c8b-bf24-2011ed9fbc4c with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8cbc4e61d92a3050b6aaa495f081e5e3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Created reservations ['b09a4b3b-ff1d-4770-b7fd-934ad1227693', '995b2840-73c2-4b6c-96ac-955d644f8a9c', 'aab4304c-52a8-4ffb-8cc0-e7f3761852a8', '7dd75201-7fba-417d-9c47-9ba71a2d762d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa160b10-4e27-4f6f-bd94-25d324c62b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73bca134-c077-48ca-a074-184c688ddf95', 'volume_size': 1, 'image_id': '7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8cbc4e61d92a3050b6aaa495f081e5e3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2f6659daf0a145fdbd4131a82139b096', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '22077d84ae50f0ea8d2e336933e31ca16e35626b31659f2e9adbcdf5e13bd2183e152cd68d057cb0b465785f0dab27a3b825e01ced667fa0acc0f26c198f9428', 'id': '7c12ff18-d526-4c8b-bf24-2011ed9fbc4c', 'created_at': datetime.datetime(2026, 11, 5, 3, 34, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 34, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7c12ff18-d526-4c8b-bf24-2011ed9fbc4c/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05f228ad50>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfd7b68-c2a6-42ca-8bd3-0d181f5ef6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:50 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Volume volume-73bca134-c077-48ca-a074-184c688ddf95 (73bca134-c077-48ca-a074-184c688ddf95): created successfully
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bfd7b68-c2a6-42ca-8bd3-0d181f5ef6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Flow 'volume_create_manager' (ad4eb0b4-08b0-4d1b-bc78-bb735267b8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2176ba3e-2cac-4d96-ae13-e76305c09331 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Created volume successfully.
Nov 05 04:34:50 devstack sudo[106341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:50 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:50 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3 1073741824" returned: 0 in 0.504s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:50 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3
Nov 05 04:34:50 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:50 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Deleted volume successfully.
Nov 05 04:34:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4e319444-0e02-45d3-b157-51907f0a0472 tempest-ProjectReaderTests-849464089 None] Lock "cinder-a2c975e0-3899-4816-aa1b-e61213c050e5-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:51 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.586s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1919978282',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9cfdf5-feb1-45a0-ae28-42d669609330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:45Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Creating volume 9d9cfdf5-feb1-45a0-ae28-42d669609330 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:51 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d25313-3d38-40c1-b818-cb8d9db898c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:51 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330 1073741824
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6248657f-7cd3-4a8e-80ab-34adf3a6f9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:51 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3 (f08bd29e-778d-40a4-8b78-fb7204cedfe3): created successfully
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6248657f-7cd3-4a8e-80ab-34adf3a6f9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (b4b40a2a-7f8d-4211-b6d1-8311287f9716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:51 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e4746b8d-f55a-439c-a4f0-5120b49f4732 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created volume successfully.
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (a7911cbc-1139-40f3-a85b-c92db1d06c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cb20dc-8bc2-4354-b219-a4d994b4d07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Acquiring lock "cinder-a1dec866-261d-4437-a2c1-f972ac12e4c8-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Lock "cinder-a1dec866-261d-4437-a2c1-f972ac12e4c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Acquiring lock "cinder-quobyte-afff7523-3ed8-4430-9c39-a72b2b5fd443" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9cb20dc-8bc2-4354-b219-a4d994b4d07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1087177753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f659e52c-87e6-4ef7-9b54-b70923fa37ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:51Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5ef426-f343-49d5-b64b-819d3e34d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa5ef426-f343-49d5-b64b-819d3e34d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cccdbe-1c53-4225-85c6-1109d81752a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cccdbe-1c53-4225-85c6-1109d81752a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f659e52c-87e6-4ef7-9b54-b70923fa37ff', 'volume_name': 'volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61255827-4aba-413d-8a9e-0614a6a9f2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61255827-4aba-413d-8a9e-0614a6a9f2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8a1936-3dd5-461e-bec8-5e8b8d28403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Volume f659e52c-87e6-4ef7-9b54-b70923fa37ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff', 'volume_size': 1}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Lock "cinder-quobyte-afff7523-3ed8-4430-9c39-a72b2b5fd443" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Acquiring lock "cinder-quobyte-a1dec866-261d-4437-a2c1-f972ac12e4c8" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Acquiring lock "cinder-73bca134-c077-48ca-a074-184c688ddf95-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Lock "cinder-quobyte-a1dec866-261d-4437-a2c1-f972ac12e4c8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Deleting offline snapshot a1dec866-261d-4437-a2c1-f972ac12e4c8 of volume afff7523-3ed8-4430-9c39-a72b2b5fd443 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] snapshot_file for this snap is: volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "cinder-73bca134-c077-48ca-a074-184c688ddf95-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4a80f1-12ea-49a4-accc-65f23c8e97f3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Acquiring lock "cinder-quobyte-73bca134-c077-48ca-a074-184c688ddf95" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "cinder-quobyte-73bca134-c077-48ca-a074-184c688ddf95" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2386b2a-3022-4e08-8131-269a00f84222]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:51 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8
Nov 05 04:34:51 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:51 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330 1073741824" returned: 0 in 0.576s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:51 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95
Nov 05 04:34:51 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:51 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330
Nov 05 04:34:51 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:51 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8" returned: 0 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afff7523-3ed8-4430-9c39-a72b2b5fd443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9df860c-45fd-43bf-9375-a68fbc37209a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:51 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330" returned: 0 in 0.255s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.082s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1456317563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f2c86c-0190-489f-9629-b74c2d0e0716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:46Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Creating volume 36f2c86c-0190-489f-9629-b74c2d0e0716 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:51 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:51 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95" returned: 0 in 0.425s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:52 devstack sudo[106368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716 1073741824
Nov 05 04:34:52 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:52 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443
Nov 05 04:34:52 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70bf00a-aa82-4b78-a3ff-2a2023cc4f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9cfdf5-feb1-45a0-ae28-42d669609330', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae003c4-8187-4870-ac6e-1c303b99473b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:52 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95
Nov 05 04:34:52 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume volume-9d9cfdf5-feb1-45a0-ae28-42d669609330 (9d9cfdf5-feb1-45a0-ae28-42d669609330): created successfully
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae003c4-8187-4870-ac6e-1c303b99473b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (4df522a0-d4a1-4e84-bcc9-1430f4d24e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-64cf314b-dae1-44e1-9a95-a055d8705901 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created volume successfully.
Nov 05 04:34:52 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-73bca134-c077-48ca-a074-184c688ddf95" returned: 0 in 0.258s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "cinder-quobyte-73bca134-c077-48ca-a074-184c688ddf95" released by "delete_volume" :: held 0.737s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:52 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443" returned: 0 in 0.409s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:52 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8
Nov 05 04:34:52 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Created reservations ['e45f777d-e228-4dfe-b993-804a1ace5b5a', '5bbcf017-4c24-43de-b3d4-dc55f65af6eb', 'af3dd686-7e13-44db-8379-40736e7759ee', '760d9c66-964f-4cd5-999f-966dac572b4a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:52 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:52 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:52 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716 1073741824" returned: 0 in 0.491s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:52 devstack sudo[106385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716
Nov 05 04:34:52 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:52 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:52 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.342s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8" returned: 0 in 0.483s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Deleted volume successfully.
Nov 05 04:34:52 devstack sudo[106392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8
Nov 05 04:34:52 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b0c2abbb-1bf7-494c-a893-a130029e20e6 tempest-VolumeAndVolumeTypeFromImageTest-294398213 None] Lock "cinder-73bca134-c077-48ca-a074-184c688ddf95-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:52 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716" returned: 0 in 0.372s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.626s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834195625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cdc29cf022a424e9e200b4923aabaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:46Z,use_quota=True,user_id='dd6d249e056e4659911bdf6ba494f1db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Creating volume 91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:52 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30799c8f-8da3-43eb-bb9d-62d44915a13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f2c86c-0190-489f-9629-b74c2d0e0716', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:52 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78 1073741824
Nov 05 04:34:52 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17946ce-f3cc-4f94-89cd-51226f125cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:52 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume volume-36f2c86c-0190-489f-9629-b74c2d0e0716 (36f2c86c-0190-489f-9629-b74c2d0e0716): created successfully
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17946ce-f3cc-4f94-89cd-51226f125cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:52 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (bdab191d-01a2-450c-893a-96094b61065c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5f8dfd81-2c4b-4c63-b3e8-02260dd579c6 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created volume successfully.
Nov 05 04:34:53 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443.a1dec866-261d-4437-a2c1-f972ac12e4c8" returned: 0 in 0.305s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Lock "cinder-quobyte-a1dec866-261d-4437-a2c1-f972ac12e4c8" released by "_delete_snapshot" :: held 1.727s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Lock "cinder-quobyte-afff7523-3ed8-4430-9c39-a72b2b5fd443" released by "delete_snapshot" :: held 1.759s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Created reservations ['23fe012b-b464-4240-a15e-77cb7377a359', '41f558ed-92c4-4ea5-9e27-41744227fa41', '42d04fa4-df7f-44a8-be5b-fae2e992a25b', '7e9c87a6-6f9b-41fa-bc48-5fe9a9b82988'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Delete snapshot completed successfully.
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-6eb0507e-5fe0-4d1d-b61b-c3aebdeca8da tempest-CinderUnicodeTest-601077571 None] Lock "cinder-a1dec866-261d-4437-a2c1-f972ac12e4c8-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:53 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78 1073741824" returned: 0 in 0.516s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:53 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78
Nov 05 04:34:53 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Acquiring lock "cinder-afff7523-3ed8-4430-9c39-a72b2b5fd443-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Lock "cinder-afff7523-3ed8-4430-9c39-a72b2b5fd443-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Acquiring lock "cinder-quobyte-afff7523-3ed8-4430-9c39-a72b2b5fd443" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Lock "cinder-quobyte-afff7523-3ed8-4430-9c39-a72b2b5fd443" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec52f1b-97ed-4e27-a3fe-56a32d146494]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:53 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:53 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443
Nov 05 04:34:53 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78" returned: 0 in 0.295s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1087177753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f659e52c-87e6-4ef7-9b54-b70923fa37ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:51Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Creating volume f659e52c-87e6-4ef7-9b54-b70923fa37ff {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:53 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:53 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff 1073741824
Nov 05 04:34:53 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1538c8a-ca46-4343-a966-fa8eb36e2172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d92ee8-7a44-47a1-a115-3065e5cc3409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:53 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Volume volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78 (91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78): created successfully
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d92ee8-7a44-47a1-a115-3065e5cc3409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:53 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Flow 'volume_create_manager' (9f353483-67cf-4743-90aa-31b7ae99904f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:53 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-41c44fb3-ce41-4f47-8f74-321a8d855667 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created volume successfully.
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:54 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443" returned: 0 in 0.458s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:54 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443
Nov 05 04:34:54 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-quobyte-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[075dc746-3ce3-4996-a3f8-5e01863851e2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:54 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78
Nov 05 04:34:54 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:54 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff 1073741824" returned: 0 in 0.664s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:54 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-afff7523-3ed8-4430-9c39-a72b2b5fd443" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Lock "cinder-quobyte-afff7523-3ed8-4430-9c39-a72b2b5fd443" released by "delete_volume" :: held 0.936s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:54 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff
Nov 05 04:34:54 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Created reservations ['7a5aa9dc-de60-4fdb-8328-213f6ca72916', '6cc2e342-0130-49e8-afaa-b5098217768f', '990381e4-7da6-4757-8d26-8e1239f27118', 'f6a7a4b6-d61a-4cf6-bb91-f94a6bdec5af'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:54 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:54 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:54 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Acquiring lock "cinder-c24280bb-2436-45e4-96c7-4fd292c1b7f2-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Lock "cinder-c24280bb-2436-45e4-96c7-4fd292c1b7f2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:54 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78
Nov 05 04:34:54 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Acquiring lock "cinder-quobyte-c24280bb-2436-45e4-96c7-4fd292c1b7f2" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Lock "cinder-quobyte-c24280bb-2436-45e4-96c7-4fd292c1b7f2" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b45c4c-658b-45a2-a200-4e5451848d17]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:54 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff" returned: 0 in 0.439s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8a1936-3dd5-461e-bec8-5e8b8d28403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf38fd00-4fb8-487f-a6a1-c59430be3c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Volume volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff (f659e52c-87e6-4ef7-9b54-b70923fa37ff): created successfully
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf38fd00-4fb8-487f-a6a1-c59430be3c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (a7911cbc-1139-40f3-a85b-c92db1d06c81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ed891d18-7b5c-4632-8a61-21f4184b38cb tempest-ProjectReaderTests-849464089 None] Created volume successfully.
Nov 05 04:34:55 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2
Nov 05 04:34:55 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:55 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.434s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Deleted volume successfully.
Nov 05 04:34:55 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0901d5fb-ee76-47d0-af52-0bb33c73c2b7 tempest-CinderUnicodeTest-601077571 None] Lock "cinder-afff7523-3ed8-4430-9c39-a72b2b5fd443-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78" released by "delete_volume" :: held 0.959s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created reservations ['ca15504c-929f-46e4-860b-e1880ebb802b', 'ec54c38c-f9ad-443a-ae0c-5baf0a7accaf', '7f63e738-89da-4ab0-9241-415be01ff77e', '5bc385f2-43fc-4d0c-9314-258a99dce8ad'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:55 devstack sudo[106439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:55 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:55 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:55 devstack sudo[106441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2
Nov 05 04:34:55 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:55 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Deleted volume successfully.
Nov 05 04:34:55 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-b9eaefdc-b6a8-4e31-b364-2c7e29724602 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-91340ba1-a4fd-4e31-82bc-0c4cf9a8ef78-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c24280bb-2436-45e4-96c7-4fd292c1b7f2" returned: 0 in 0.321s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Lock "cinder-quobyte-c24280bb-2436-45e4-96c7-4fd292c1b7f2" released by "delete_volume" :: held 0.843s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Creating offline snapshot bf758f77-3aa4-4257-a3b0-da00dd8381b2 of volume f659e52c-87e6-4ef7-9b54-b70923fa37ff {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92a9ca-169b-4ca8-90d1-fe4bdc04bad8]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Created reservations ['b36b16d3-8c7d-4fdb-91a7-c137ba181218', 'a38ee14f-0ba5-4222-b793-a9650bd752be', 'fe0abf43-7388-4b9a-a198-23e360f2d0be', '72245815-6622-45ad-90ad-c416e6a9bb67'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:55 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff
Nov 05 04:34:55 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:55 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:55 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:56 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff" returned: 0 in 0.458s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:56 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:56 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 1G
Nov 05 04:34:56 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:56 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Deleted volume successfully.
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-dffa985b-8896-429f-a8e8-bd400720fecb tempest-CinderUnicodeTest-601077571 None] Lock "cinder-c24280bb-2436-45e4-96c7-4fd292c1b7f2-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-36f2c86c-0190-489f-9629-b74c2d0e0716-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-36f2c86c-0190-489f-9629-b74c2d0e0716-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-quobyte-36f2c86c-0190-489f-9629-b74c2d0e0716" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-36f2c86c-0190-489f-9629-b74c2d0e0716" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e55643-522e-4af5-883c-ad15e79dd4ca]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:56 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716
Nov 05 04:34:56 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:56 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 1G" returned: 0 in 0.612s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:56 devstack sudo[106460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2
Nov 05 04:34:56 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:57 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716" returned: 0 in 0.476s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:57 devstack sudo[106465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716
Nov 05 04:34:57 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:57 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2" returned: 0 in 0.368s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:57 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 is being set with open permissions: ugo+rw
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:57 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2
Nov 05 04:34:57 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:57 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-36f2c86c-0190-489f-9629-b74c2d0e0716" returned: 0 in 0.321s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-36f2c86c-0190-489f-9629-b74c2d0e0716" released by "delete_volume" :: held 0.865s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created reservations ['5dabfb03-76d9-4892-bea5-ebb4f5ad36b3', 'bb852482-23c1-41b7-aeb6-5f87f8059b04', '2d40c6ab-17b7-4774-8a49-e16eeb04a7dc', '3b78faea-3565-49c0-9711-1fd598dc4453'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:57 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2" returned: 0 in 0.298s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:57 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:57 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:57 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.info
Nov 05 04:34:57 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-9d9cfdf5-feb1-45a0-ae28-42d669609330-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-9d9cfdf5-feb1-45a0-ae28-42d669609330-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-quobyte-9d9cfdf5-feb1-45a0-ae28-42d669609330" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-9d9cfdf5-feb1-45a0-ae28-42d669609330" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:57 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:57 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Deleted volume successfully.
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5466c6be-379f-441c-a9fa-10678ffcdbe2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7211f099-8e6e-436a-876a-1e74c9f5b3db tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-36f2c86c-0190-489f-9629-b74c2d0e0716-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:58 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.info" returned: 0 in 0.398s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:58 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.info is being set with open permissions: ugo+rw
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:58 devstack sudo[106479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330
Nov 05 04:34:58 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:58 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.info
Nov 05 04:34:58 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:58 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:58 devstack sudo[106489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330
Nov 05 04:34:58 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:58 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.info" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.605s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ef1d559f-fe63-466d-a884-4fdafdff3fed tempest-ProjectReaderTests-849464089 None] Create snapshot completed successfully
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (141d6676-b968-41ba-ac83-4de0248c64c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22619dae-b6a4-4aa2-8397-beb59ea3621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22619dae-b6a4-4aa2-8397-beb59ea3621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1770166224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa08a381-3ba1-474d-b074-f65fa54881b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:58Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1d306c-4331-4d6d-a6b2-88ffdddf7f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb1d306c-4331-4d6d-a6b2-88ffdddf7f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:58 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43007422-183a-462e-9e08-45be9fcd4512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43007422-183a-462e-9e08-45be9fcd4512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa08a381-3ba1-474d-b074-f65fa54881b9', 'volume_name': 'volume-fa08a381-3ba1-474d-b074-f65fa54881b9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e556b1-4b5c-4edd-b907-1d7a2dda0d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5e556b1-4b5c-4edd-b907-1d7a2dda0d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17c51f9-54d3-4394-92bc-cb32c9ae54ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Volume fa08a381-3ba1-474d-b074-f65fa54881b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa08a381-3ba1-474d-b074-f65fa54881b9', 'volume_size': 1}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1770166224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa08a381-3ba1-474d-b074-f65fa54881b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:58Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Creating volume fa08a381-3ba1-474d-b074-f65fa54881b9 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:34:58 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9d9cfdf5-feb1-45a0-ae28-42d669609330" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-9d9cfdf5-feb1-45a0-ae28-42d669609330" released by "delete_volume" :: held 0.858s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:58 devstack sudo[106492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9 1073741824
Nov 05 04:34:58 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created reservations ['3d558976-6d4d-4a64-80be-a7fb8978e529', '589fc229-7bda-4630-b66f-eb5e734fbc98', '173c11ce-6c83-4972-b07a-dbc9863c61f4', 'fd808bee-39a3-477e-b050-19afb4104652'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:34:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-f08bd29e-778d-40a4-8b78-fb7204cedfe3-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:58 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-f08bd29e-778d-40a4-8b78-fb7204cedfe3-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:58 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-quobyte-f08bd29e-778d-40a4-8b78-fb7204cedfe3" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-f08bd29e-778d-40a4-8b78-fb7204cedfe3" acquired by "delete_volume" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b32a3a-ebd8-447f-802a-2f4e8dd3b46e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (6781ebec-9c1b-4a27-8919-e9c24b160d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3de9c32-7a7a-4005-b5ad-b5ee22e34ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:59 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9 1073741824" returned: 0 in 0.758s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3de9c32-7a7a-4005-b5ad-b5ee22e34ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023823784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:59Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95932227-bc1a-498d-b281-59057145f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95932227-bc1a-498d-b281-59057145f762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34999bd2-ad8b-4193-b90e-d5f99f081bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:59 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34999bd2-ad8b-4193-b90e-d5f99f081bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b', 'volume_name': 'volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ab8371-0cda-4350-8174-b65ca27d6293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:59 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3
Nov 05 04:34:59 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93ab8371-0cda-4350-8174-b65ca27d6293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96d1e8f-b10a-4845-a53d-ec974b885fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Volume de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b', 'volume_size': 1}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-bf758f77-3aa4-4257-a3b0-da00dd8381b2-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.626s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:34:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Deleted volume successfully.
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Lock "cinder-bf758f77-3aa4-4257-a3b0-da00dd8381b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-f659e52c-87e6-4ef7-9b54-b70923fa37ff" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-f659e52c-87e6-4ef7-9b54-b70923fa37ff" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-bf758f77-3aa4-4257-a3b0-da00dd8381b2" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f787fbca-0aca-45bf-97b9-da7af31887b1 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-9d9cfdf5-feb1-45a0-ae28-42d669609330-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-bf758f77-3aa4-4257-a3b0-da00dd8381b2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Deleting offline snapshot bf758f77-3aa4-4257-a3b0-da00dd8381b2 of volume f659e52c-87e6-4ef7-9b54-b70923fa37ff {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:34:59 devstack sudo[106504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9
Nov 05 04:34:59 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] snapshot_file for this snap is: volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad66628-e36e-46db-bc82-ba00b1db0bac]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:34:59 devstack sudo[106506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2
Nov 05 04:34:59 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:34:59 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (94a475f9-53e9-4f23-8b09-2da452625a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc86c1f-3444-4693-9a63-e521a9e03ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3" returned: 0 in 0.746s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:34:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc86c1f-3444-4693-9a63-e521a9e03ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930195477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400ec160-e631-4ac6-b9cb-27cec636c11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:00Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3
Nov 05 04:35:00 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892aa3e9-148d-4451-862a-36934a82c47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892aa3e9-148d-4451-862a-36934a82c47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1482a6ca-b251-4817-baf7-3269aedea19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1482a6ca-b251-4817-baf7-3269aedea19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400ec160-e631-4ac6-b9cb-27cec636c11c', 'volume_name': 'volume-400ec160-e631-4ac6-b9cb-27cec636c11c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b7d8a1-4345-4644-9624-769d19cb9dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b7d8a1-4345-4644-9624-769d19cb9dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2c8b4e-60b2-41f1-a841-83d336c93fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Volume 400ec160-e631-4ac6-b9cb-27cec636c11c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400ec160-e631-4ac6-b9cb-27cec636c11c', 'volume_size': 1}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9" returned: 0 in 0.557s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2023823784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:34:59Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Creating volume de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:00 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:00 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b 1073741824
Nov 05 04:35:00 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17c51f9-54d3-4394-92bc-cb32c9ae54ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa08a381-3ba1-474d-b074-f65fa54881b9', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4925824-61fd-47c4-890a-63d2bd6f522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Volume volume-fa08a381-3ba1-474d-b074-f65fa54881b9 (fa08a381-3ba1-474d-b074-f65fa54881b9): created successfully
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4925824-61fd-47c4-890a-63d2bd6f522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (141d6676-b968-41ba-ac83-4de0248c64c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3e41625f-6fef-4156-b4e0-369bf545e81f tempest-CreateVolumesFromImageTest-1824241170 None] Created volume successfully.
Nov 05 04:35:00 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2" returned: 0 in 0.660s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:35:00 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f4bef9-76cc-47a1-ab5b-7c01def4ad6a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f08bd29e-778d-40a4-8b78-fb7204cedfe3" returned: 0 in 0.446s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-f08bd29e-778d-40a4-8b78-fb7204cedfe3" released by "delete_volume" :: held 1.295s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (5cc23ab6-6158-430d-a957-d27b26c96d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8ea92d-239f-4df1-b98f-bc7190d2fac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8ea92d-239f-4df1-b98f-bc7190d2fac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1573665883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abee3ced-466b-4827-bc4d-db69c6cfe7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:00Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff
Nov 05 04:35:00 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ead814-6bd5-4864-a96f-b78e9b6a6de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ead814-6bd5-4864-a96f-b78e9b6a6de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4347089c-9f18-41cc-93ca-33ffae72c35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4347089c-9f18-41cc-93ca-33ffae72c35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abee3ced-466b-4827-bc4d-db69c6cfe7de', 'volume_name': 'volume-abee3ced-466b-4827-bc4d-db69c6cfe7de', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57e37f7-2734-438d-a9f4-a7b9aca1a9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b57e37f7-2734-438d-a9f4-a7b9aca1a9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd422f9-2a27-4a2f-8ebe-29338a6c6fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Volume abee3ced-466b-4827-bc4d-db69c6cfe7de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abee3ced-466b-4827-bc4d-db69c6cfe7de', 'volume_size': 1}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created reservations ['d6efdc32-04da-4a63-9bdf-eb86a2839d3b', 'd3b4b478-ad0b-46ea-a683-7f4a7c017c5b', 'ad2b52ba-e2c8-4f62-b894-b59698ed354e', 'e50feee2-6843-4da6-b383-1ceba72a4dce'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:00 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b 1073741824" returned: 0 in 0.744s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:01 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:01 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:01 devstack sudo[106532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b
Nov 05 04:35:01 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:01 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff" returned: 0 in 0.732s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:01 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2
Nov 05 04:35:01 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (304a353f-561e-482f-9c6c-dde7b378943c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4624344-4940-4de2-9971-2a33ef1d41cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4624344-4940-4de2-9971-2a33ef1d41cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-869428502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256273d9-e898-4c46-9bfc-bcae1d2b7200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:01Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5c8fcb-4767-4221-97cf-0dfa6a9bbd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5c8fcb-4767-4221-97cf-0dfa6a9bbd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17527a07-490e-40bf-94af-3eff846e7b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17527a07-490e-40bf-94af-3eff846e7b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256273d9-e898-4c46-9bfc-bcae1d2b7200', 'volume_name': 'volume-256273d9-e898-4c46-9bfc-bcae1d2b7200', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd60473-f1ba-48d7-8be1-7c7ede81d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:01 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd60473-f1ba-48d7-8be1-7c7ede81d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deace095-c73a-4dd9-bcf9-4cf2e92f6108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Volume 256273d9-e898-4c46-9bfc-bcae1d2b7200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256273d9-e898-4c46-9bfc-bcae1d2b7200', 'volume_size': 1}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.336s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Deleted volume successfully.
Nov 05 04:35:01 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b" returned: 0 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c8127abb-8c09-4c71-98b5-8f714adbaa4d tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-f08bd29e-778d-40a4-8b78-fb7204cedfe3-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.198s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:34:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930195477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400ec160-e631-4ac6-b9cb-27cec636c11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:00Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Creating volume 400ec160-e631-4ac6-b9cb-27cec636c11c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:01 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96d1e8f-b10a-4845-a53d-ec974b885fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:01 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c 1073741824
Nov 05 04:35:01 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852036cd-92e1-4f40-b8ae-e90a4c163a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:01 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Volume volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b (de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b): created successfully
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (852036cd-92e1-4f40-b8ae-e90a4c163a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (6781ebec-9c1b-4a27-8919-e9c24b160d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-50256a3c-3ffc-4404-8f4e-df548b464a75 tempest-CreateVolumesFromImageTest-1824241170 None] Created volume successfully.
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-42c00f29-db45-49f8-a582-d6b0160a8679-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-42c00f29-db45-49f8-a582-d6b0160a8679-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-quobyte-42c00f29-db45-49f8-a582-d6b0160a8679" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-42c00f29-db45-49f8-a582-d6b0160a8679" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe65bfc-d5d6-4b41-9f01-3507f7110d6a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:01 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2" returned: 0 in 0.512s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:01 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2
Nov 05 04:35:01 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:01 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679
Nov 05 04:35:01 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:01 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c 1073741824" returned: 0 in 0.561s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:01 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff.bf758f77-3aa4-4257-a3b0-da00dd8381b2" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-bf758f77-3aa4-4257-a3b0-da00dd8381b2" released by "_delete_snapshot" :: held 2.311s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-f659e52c-87e6-4ef7-9b54-b70923fa37ff" released by "delete_snapshot" :: held 2.352s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:02 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c
Nov 05 04:35:02 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:02 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Created reservations ['55378651-4c0c-4b98-9eac-cc2059f7d913', '06b92bc2-4724-4bb3-9b04-62e45dae9dc9', '46a45890-eb88-48a4-89f8-1b0972a2f666', '9dcca394-e918-4310-8853-95e4fe31d16b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679" returned: 0 in 0.437s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:02 devstack sudo[106561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679
Nov 05 04:35:02 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Delete snapshot completed successfully.
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-d0fe8dd5-426c-4ad8-88a9-2aa467daeb54 tempest-ProjectReaderTests-849464089 None] Lock "cinder-bf758f77-3aa4-4257-a3b0-da00dd8381b2-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:02 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c" returned: 0 in 0.285s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.597s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1573665883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abee3ced-466b-4827-bc4d-db69c6cfe7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:00Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Creating volume abee3ced-466b-4827-bc4d-db69c6cfe7de {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:02 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:02 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de 1073741824
Nov 05 04:35:02 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f2c8b4e-60b2-41f1-a841-83d336c93fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400ec160-e631-4ac6-b9cb-27cec636c11c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541d5ca3-e339-4f9e-93ca-1001b6f98349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:02 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:02 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Volume volume-400ec160-e631-4ac6-b9cb-27cec636c11c (400ec160-e631-4ac6-b9cb-27cec636c11c): created successfully
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541d5ca3-e339-4f9e-93ca-1001b6f98349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (94a475f9-53e9-4f23-8b09-2da452625a56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-42c00f29-db45-49f8-a582-d6b0160a8679" returned: 0 in 0.300s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-42c00f29-db45-49f8-a582-d6b0160a8679" released by "delete_volume" :: held 0.794s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-52280d1f-9dbd-4a4b-89b1-effd47b52d9e tempest-CreateVolumesFromImageTest-1824241170 None] Created volume successfully.
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created reservations ['bcdea609-22c3-4bcc-862a-719db37b036c', 'daedb70e-49f6-43d4-b69f-4ffef9a76609', 'e8b16287-eded-479c-9850-4ad6ec886e37', 'd26718a9-04c7-4826-bb01-4a42cd9cc88c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:02 devstack sudo[106569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:02 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-fe8f96db-278c-4f71-bc84-fc8e3956e403-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:02 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-fe8f96db-278c-4f71-bc84-fc8e3956e403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-quobyte-691163be-938b-47f8-bb6a-fdb18a9415ce" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.286s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Deleted volume successfully.
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-691163be-938b-47f8-bb6a-fdb18a9415ce" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-quobyte-fe8f96db-278c-4f71-bc84-fc8e3956e403" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-fe8f96db-278c-4f71-bc84-fc8e3956e403" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Deleting offline snapshot fe8f96db-278c-4f71-bc84-fc8e3956e403 of volume 691163be-938b-47f8-bb6a-fdb18a9415ce {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] snapshot_file for this snap is: volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:35:02 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de 1073741824" returned: 0 in 0.567s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4418e924-12dd-4c29-aed3-6e58d4ba9f30 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-42c00f29-db45-49f8-a582-d6b0160a8679-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[230f96fa-0a76-4a8a-92e3-0499ae5bef2b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-f659e52c-87e6-4ef7-9b54-b70923fa37ff-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:02 devstack sudo[106575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de
Nov 05 04:35:02 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Lock "cinder-f659e52c-87e6-4ef7-9b54-b70923fa37ff-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:03 devstack sudo[106574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403
Nov 05 04:35:03 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-f659e52c-87e6-4ef7-9b54-b70923fa37ff" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-f659e52c-87e6-4ef7-9b54-b70923fa37ff" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[018824a1-527e-4e9f-aa40-7431126c57c0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:03 devstack sudo[106578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff
Nov 05 04:35:03 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:03 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-869428502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256273d9-e898-4c46-9bfc-bcae1d2b7200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51fabd510cda4ca88bfe357eae19992a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:01Z,use_quota=True,user_id='32a47d7304334c3b8c4446e4feb8ab83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Creating volume 256273d9-e898-4c46-9bfc-bcae1d2b7200 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd422f9-2a27-4a2f-8ebe-29338a6c6fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abee3ced-466b-4827-bc4d-db69c6cfe7de', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:03 devstack sudo[106583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200 1073741824
Nov 05 04:35:03 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0911691e-b6eb-4a2b-95c2-994875a2177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Volume volume-abee3ced-466b-4827-bc4d-db69c6cfe7de (abee3ced-466b-4827-bc4d-db69c6cfe7de): created successfully
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0911691e-b6eb-4a2b-95c2-994875a2177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (5cc23ab6-6158-430d-a957-d27b26c96d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e597313e-36de-4b07-9d9d-ba0e212b1f5d tempest-CreateVolumesFromImageTest-1824241170 None] Created volume successfully.
Nov 05 04:35:03 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403" returned: 0 in 0.565s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-691163be-938b-47f8-bb6a-fdb18a9415ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2766890-d66c-49c5-8fd4-7cf510b6986d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:03 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce
Nov 05 04:35:03 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:03 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff" returned: 0 in 0.474s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:03 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff
Nov 05 04:35:03 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:03 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200 1073741824" returned: 0 in 0.481s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:03 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:03 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:03 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200
Nov 05 04:35:03 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f659e52c-87e6-4ef7-9b54-b70923fa37ff" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:03 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403
Nov 05 04:35:03 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-f659e52c-87e6-4ef7-9b54-b70923fa37ff" released by "delete_volume" :: held 0.860s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Created reservations ['eae6d945-5e9f-4c60-916a-bcc55a4621ac', '8e6cd3ca-7d9d-4b6d-b937-399cb11dc0d3', '102a46fd-e9c1-4c93-a19b-c727ab4088a2', 'bd57a7c5-d7db-4288-8e68-43a783e9edd1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:04 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:04 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:04 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200" returned: 0 in 0.295s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deace095-c73a-4dd9-bcf9-4cf2e92f6108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256273d9-e898-4c46-9bfc-bcae1d2b7200', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b399cd-49bc-4614-8a02-f7b7729e36fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Volume volume-256273d9-e898-4c46-9bfc-bcae1d2b7200 (256273d9-e898-4c46-9bfc-bcae1d2b7200): created successfully
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b399cd-49bc-4614-8a02-f7b7729e36fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Flow 'volume_create_manager' (304a353f-561e-482f-9c6c-dde7b378943c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-da173965-ca1f-4fe2-bd92-2338a1661a05 tempest-CreateVolumesFromImageTest-1824241170 None] Created volume successfully.
Nov 05 04:35:04 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:04 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403
Nov 05 04:35:04 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:04 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.316s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Deleted volume successfully.
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a6fc4360-a8ab-437a-af5e-dbcd9be7368d tempest-ProjectReaderTests-849464089 None] Lock "cinder-f659e52c-87e6-4ef7-9b54-b70923fa37ff-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-256273d9-e898-4c46-9bfc-bcae1d2b7200-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-256273d9-e898-4c46-9bfc-bcae1d2b7200-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-quobyte-256273d9-e898-4c46-9bfc-bcae1d2b7200" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-256273d9-e898-4c46-9bfc-bcae1d2b7200" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dfb30e-4dd3-48d0-93ee-495e57719b7f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:04 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce.fe8f96db-278c-4f71-bc84-fc8e3956e403" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-fe8f96db-278c-4f71-bc84-fc8e3956e403" released by "_delete_snapshot" :: held 1.959s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-691163be-938b-47f8-bb6a-fdb18a9415ce" released by "delete_snapshot" :: held 1.989s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:04 devstack sudo[106617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200
Nov 05 04:35:04 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (caf9a949-5bda-4770-870e-3f7033ccab3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2decd2a-0894-4761-93c9-31ff1ba6287b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2decd2a-0894-4761-93c9-31ff1ba6287b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78410494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d04bf4-5bab-4fce-8658-bcab5efc288c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:05Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2821ce6b-abd3-491e-855b-bcd198361ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2821ce6b-abd3-491e-855b-bcd198361ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc718407-b41f-4482-967d-142afa1aa7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc718407-b41f-4482-967d-142afa1aa7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d04bf4-5bab-4fce-8658-bcab5efc288c', 'volume_name': 'volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25424df-fce6-47fa-a7e3-83220539a4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f25424df-fce6-47fa-a7e3-83220539a4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0b884f-db77-4df6-82a5-eccc468b8cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Volume f8d04bf4-5bab-4fce-8658-bcab5efc288c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c', 'volume_size': 1}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78410494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d04bf4-5bab-4fce-8658-bcab5efc288c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:05Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Creating volume f8d04bf4-5bab-4fce-8658-bcab5efc288c {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:04 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:05 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c 1073741824
Nov 05 04:35:05 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created reservations ['5669a851-d0e4-49f1-a0a1-30de2d1c82de', 'de437c40-9f0b-4a76-8fbe-e0fce66cbad6', '3cf20c77-2838-4207-912a-05425be67e0f', '5000b3d7-590c-4f62-a94c-224c811f5e57'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Delete snapshot completed successfully.
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3d1d48db-9cca-44dd-a14a-4c735c24ab6c tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-fe8f96db-278c-4f71-bc84-fc8e3956e403-delete_snapshot" released by "delete_snapshot" :: held 2.331s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:05 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200" returned: 0 in 0.476s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:05 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200
Nov 05 04:35:05 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:05 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-256273d9-e898-4c46-9bfc-bcae1d2b7200" returned: 0 in 0.273s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-256273d9-e898-4c46-9bfc-bcae1d2b7200" released by "delete_volume" :: held 0.815s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Created reservations ['e3a8a286-0116-40c1-a06e-9b2e90d8b74b', '8337956b-1379-43b0-8735-69320c7d77bb', '0bb77bef-e4af-421e-abaa-359028b1af7b', 'f98de033-1e1e-483d-b334-7a99b9eaeab3'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:05 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c 1073741824" returned: 0 in 0.552s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:05 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:05 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:05 devstack sudo[106632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:05 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-abee3ced-466b-4827-bc4d-db69c6cfe7de-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-abee3ced-466b-4827-bc4d-db69c6cfe7de-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-quobyte-abee3ced-466b-4827-bc4d-db69c6cfe7de" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-abee3ced-466b-4827-bc4d-db69c6cfe7de" acquired by "delete_volume" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:05 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c" returned: 0 in 0.362s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b10124-9ca6-4981-af5c-257baf6d9f06]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0b884f-db77-4df6-82a5-eccc468b8cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:05 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f61941c-7d57-42f1-9eef-04232012808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:06 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.369s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:06 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Volume volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c (f8d04bf4-5bab-4fce-8658-bcab5efc288c): created successfully
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f61941c-7d57-42f1-9eef-04232012808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (caf9a949-5bda-4770-870e-3f7033ccab3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Deleted volume successfully.
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-691163be-938b-47f8-bb6a-fdb18a9415ce-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-8da75120-8d05-47b4-9fe5-6ec2bfd19469 tempest-ProjectReaderTests-849464089 None] Created volume successfully.
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-691163be-938b-47f8-bb6a-fdb18a9415ce-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4debd67f-3a2a-4803-82ba-a35314bdeb21 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-256273d9-e898-4c46-9bfc-bcae1d2b7200-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:06 devstack sudo[106636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de
Nov 05 04:35:06 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "cinder-quobyte-691163be-938b-47f8-bb6a-fdb18a9415ce" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-691163be-938b-47f8-bb6a-fdb18a9415ce" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c896a762-6cca-4739-8535-226d0b38dc45]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:06 devstack sudo[106638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce
Nov 05 04:35:06 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:06 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de" returned: 0 in 0.405s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:06 devstack sudo[106643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de
Nov 05 04:35:06 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:06 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce" returned: 0 in 0.366s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:06 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce
Nov 05 04:35:06 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:06 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-abee3ced-466b-4827-bc4d-db69c6cfe7de" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-abee3ced-466b-4827-bc4d-db69c6cfe7de" released by "delete_volume" :: held 0.725s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Created reservations ['53e181be-1017-4fc9-8d29-bbd7b9193670', '7a37d540-a7b8-413a-a90c-941fa5edb52c', 'c5e31f8c-31c4-4d6a-8cc9-0322f3aac9a5', 'cfecb945-cb16-4dc2-8d71-0ca6197d0391'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:06 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-691163be-938b-47f8-bb6a-fdb18a9415ce" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:06 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:06 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-quobyte-691163be-938b-47f8-bb6a-fdb18a9415ce" released by "delete_volume" :: held 0.731s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Created reservations ['1b98bab2-8df3-424b-9ec5-f289dd399db0', '16848e94-8eb0-4615-836d-b992c1356046', 'dbf01238-1cd2-4686-9679-1b3356ea2287', '32f4315f-0b22-4dec-b98d-7e31ed1f020e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:07 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:07 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:07 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-400ec160-e631-4ac6-b9cb-27cec636c11c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.343s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Creating offline snapshot e85e4c7b-72da-42cc-be77-068e3d95ed73 of volume f8d04bf4-5bab-4fce-8658-bcab5efc288c {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-400ec160-e631-4ac6-b9cb-27cec636c11c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Deleted volume successfully.
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1252145-a9b6-46a0-a2b7-fc08a406e97b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ff26ed73-4fd2-439c-9e6e-5923544cff06 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-abee3ced-466b-4827-bc4d-db69c6cfe7de-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-quobyte-400ec160-e631-4ac6-b9cb-27cec636c11c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-400ec160-e631-4ac6-b9cb-27cec636c11c" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8be7005-f7ef-4121-8a31-8851803c0c29]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:07 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c
Nov 05 04:35:07 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:07 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Deleted volume successfully.
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d9ff255-f4b3-4693-bab4-c5db39a7ad19 tempest-CreateVolumesFromSnapshotTest-1689423764 None] Lock "cinder-691163be-938b-47f8-bb6a-fdb18a9415ce-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:07 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c
Nov 05 04:35:07 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:07 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c" returned: 0 in 0.577s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:07 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 1G
Nov 05 04:35:07 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:07 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c" returned: 0 in 0.517s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:07 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c
Nov 05 04:35:07 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:08 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-400ec160-e631-4ac6-b9cb-27cec636c11c" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-400ec160-e631-4ac6-b9cb-27cec636c11c" released by "delete_volume" :: held 0.905s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Created reservations ['37db5a98-1052-4ba7-aa3c-b8036ff0572f', '3bc4d709-0375-49d6-8320-b4c5ffd53cc2', 'eb52ce2d-cd86-4bbe-8ecd-683fe2cd8521', '70855c35-13eb-4ba3-af5d-f268b117c16e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:08 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 1G" returned: 0 in 0.538s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:08 devstack sudo[106679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73
Nov 05 04:35:08 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:08 devstack sudo[106681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:08 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:08 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:08 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Deleted volume successfully.
Nov 05 04:35:08 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73" returned: 0 in 0.422s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:08 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 is being set with open permissions: ugo+rw
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3de387f9-6467-46d9-9c94-0535ffe6af4f tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-400ec160-e631-4ac6-b9cb-27cec636c11c-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:08 devstack sudo[106688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73
Nov 05 04:35:08 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:09 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73" returned: 0 in 0.315s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:09 devstack sudo[106691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.info
Nov 05 04:35:09 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:09 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.info" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:09 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.info is being set with open permissions: ugo+rw
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:09 devstack sudo[106694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.info
Nov 05 04:35:09 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-quobyte-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b" acquired by "delete_volume" :: waited 0.043s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:09 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.info" returned: 0 in 0.338s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.608s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[586a89a1-66e8-41ca-aa02-3a5d1bd60f81]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:09 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-daf801e9-7e23-4e43-a18a-a8af3efb51e0 tempest-ProjectReaderTests-849464089 None] Create snapshot completed successfully
Nov 05 04:35:09 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b
Nov 05 04:35:09 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:10 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b" returned: 0 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:10 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b
Nov 05 04:35:10 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-e85e4c7b-72da-42cc-be77-068e3d95ed73-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Lock "cinder-e85e4c7b-72da-42cc-be77-068e3d95ed73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-f8d04bf4-5bab-4fce-8658-bcab5efc288c" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-f8d04bf4-5bab-4fce-8658-bcab5efc288c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-e85e4c7b-72da-42cc-be77-068e3d95ed73" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-e85e4c7b-72da-42cc-be77-068e3d95ed73" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Deleting offline snapshot e85e4c7b-72da-42cc-be77-068e3d95ed73 of volume f8d04bf4-5bab-4fce-8658-bcab5efc288c {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:35:10 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] snapshot_file for this snap is: volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b" returned: 0 in 0.336s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b" released by "delete_volume" :: held 0.842s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8251aa60-c33c-45c3-b319-d519d856f3fc]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Created reservations ['7fa314dd-b72a-4523-ba18-9d57d3c9b0ec', 'e398c745-1e6d-4b0d-b51a-546f1ef4b214', 'ddec27b5-dceb-4251-8c3b-c53a264c529e', '66b90090-dfbd-4635-a057-fd8c6673fd54'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:10 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73
Nov 05 04:35:10 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:10 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:10 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-fa08a381-3ba1-474d-b074-f65fa54881b9-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-fa08a381-3ba1-474d-b074-f65fa54881b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "cinder-quobyte-fa08a381-3ba1-474d-b074-f65fa54881b9" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-fa08a381-3ba1-474d-b074-f65fa54881b9" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c64ef1-24f4-45eb-b0d0-6510a29876ad]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:11 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73" returned: 0 in 0.584s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:35:11 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Deleted volume successfully.
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa91dd4-04b5-4939-bad1-8f3fe1c87d3b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7f3d0542-cfc2-408b-9d87-03ef62478fea tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-de5c1ab8-3fee-4ad4-88fe-a1b9127cd50b-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:11 devstack sudo[106715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9
Nov 05 04:35:11 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:11 devstack sudo[106716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c
Nov 05 04:35:11 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:11 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (dfe96466-a811-4d44-9c97-da72a5052b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaab862-2536-4d06-bd8a-afeef6a6d582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9" returned: 0 in 0.536s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:11 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9
Nov 05 04:35:11 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffaab862-2536-4d06-bd8a-afeef6a6d582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369219374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1bebd9-0cc1-4414-ac18-d9913876db30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:12Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c939cdd-0335-4149-a0db-33200a2a0ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c939cdd-0335-4149-a0db-33200a2a0ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987ef919-2976-4e9c-8d63-6db30f5c50e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987ef919-2976-4e9c-8d63-6db30f5c50e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1bebd9-0cc1-4414-ac18-d9913876db30', 'volume_name': 'volume-ec1bebd9-0cc1-4414-ac18-d9913876db30', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac77f06-aab8-4f10-a0f3-e88245cef238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac77f06-aab8-4f10-a0f3-e88245cef238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1c2275-2807-4e25-9ca2-024d4e7d78e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:11 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume ec1bebd9-0cc1-4414-ac18-d9913876db30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1bebd9-0cc1-4414-ac18-d9913876db30', 'volume_size': 1}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:11 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369219374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1bebd9-0cc1-4414-ac18-d9913876db30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:12Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Creating volume ec1bebd9-0cc1-4414-ac18-d9913876db30 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:11 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c" returned: 0 in 0.577s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:11 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30 1073741824
Nov 05 04:35:11 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:11 devstack sudo[106729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73
Nov 05 04:35:11 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:11 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-fa08a381-3ba1-474d-b074-f65fa54881b9" returned: 0 in 0.291s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-quobyte-fa08a381-3ba1-474d-b074-f65fa54881b9" released by "delete_volume" :: held 0.891s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Created reservations ['f5900852-7300-4f34-9375-97a47f8ec92b', '4ce95ff7-7981-4782-866f-687f09ceecff', 'd00fa541-7e50-4876-a09d-f0fe8b224a6f', 'f60f9542-a842-4889-8c4b-7af86e79537d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:12 devstack sudo[106739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:12 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:12 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73" returned: 0 in 0.479s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:12 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73
Nov 05 04:35:12 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:12 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30 1073741824" returned: 0 in 0.626s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:12 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.363s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:12 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30
Nov 05 04:35:12 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Deleted volume successfully.
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2af01dcb-f015-4276-bd72-a14f4b26f0c6 tempest-CreateVolumesFromImageTest-1824241170 None] Lock "cinder-fa08a381-3ba1-474d-b074-f65fa54881b9-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:12 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c.e85e4c7b-72da-42cc-be77-068e3d95ed73" returned: 0 in 0.346s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-e85e4c7b-72da-42cc-be77-068e3d95ed73" released by "_delete_snapshot" :: held 2.141s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-f8d04bf4-5bab-4fce-8658-bcab5efc288c" released by "delete_snapshot" :: held 2.169s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Created reservations ['c8fb8226-95ab-4fef-94d2-ef7b8a41f518', '743d981e-5c42-40d4-9fc0-d4a066435aed', 'a13592a0-002b-4d61-8f85-3550737c30bc', '851d1f42-86ce-4e62-b3a0-ce4807bba8ed'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Delete snapshot completed successfully.
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5b8ba7e4-eb08-48e0-9866-f28d1694bc42 tempest-ProjectReaderTests-849464089 None] Lock "cinder-e85e4c7b-72da-42cc-be77-068e3d95ed73-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:12 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df1c2275-2807-4e25-9ca2-024d4e7d78e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1bebd9-0cc1-4414-ac18-d9913876db30', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5890d50e-ceb5-4e55-9aac-71d6efbd0a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume volume-ec1bebd9-0cc1-4414-ac18-d9913876db30 (ec1bebd9-0cc1-4414-ac18-d9913876db30): created successfully
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5890d50e-ceb5-4e55-9aac-71d6efbd0a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (dfe96466-a811-4d44-9c97-da72a5052b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-308b6906-8b83-49a2-8c86-0c30765f3b82 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created volume successfully.
Nov 05 04:35:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-f8d04bf4-5bab-4fce-8658-bcab5efc288c-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Lock "cinder-f8d04bf4-5bab-4fce-8658-bcab5efc288c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-f8d04bf4-5bab-4fce-8658-bcab5efc288c" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:13 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-f8d04bf4-5bab-4fce-8658-bcab5efc288c" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:13 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bbf99c-5f76-44fd-b530-207891eddcfb]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:14 devstack sudo[106752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c
Nov 05 04:35:14 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (0d2393ad-100e-425a-98dc-f1cf519d2ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bb6cee-5c02-4b10-9da3-01950acc128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bb6cee-5c02-4b10-9da3-01950acc128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870765185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a039064-1828-481a-a9e9-d54e269db4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:14Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8d7026-a26f-4048-81b1-c250be53ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd8d7026-a26f-4048-81b1-c250be53ec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:14 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e7d469-811a-4a0e-9c84-3389f3442286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e7d469-811a-4a0e-9c84-3389f3442286) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a039064-1828-481a-a9e9-d54e269db4b0', 'volume_name': 'volume-7a039064-1828-481a-a9e9-d54e269db4b0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df53c23-703c-47de-82ba-94c738c9c1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df53c23-703c-47de-82ba-94c738c9c1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5762f636-fe92-4388-a976-b6f0e23b93c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:14 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume 7a039064-1828-481a-a9e9-d54e269db4b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a039064-1828-481a-a9e9-d54e269db4b0', 'volume_size': 1}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1870765185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a039064-1828-481a-a9e9-d54e269db4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:14Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Creating volume 7a039064-1828-481a-a9e9-d54e269db4b0 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:14 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c" returned: 0 in 0.672s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:14 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0 1073741824
Nov 05 04:35:14 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:14 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c
Nov 05 04:35:14 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:15 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f8d04bf4-5bab-4fce-8658-bcab5efc288c" returned: 0 in 0.482s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-f8d04bf4-5bab-4fce-8658-bcab5efc288c" released by "delete_volume" :: held 1.288s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (9bba8a72-6a6a-4266-8385-fdf50eb8f178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ea57f7-6d54-4997-b422-cf4919652e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ea57f7-6d54-4997-b422-cf4919652e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903942120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f5ee39-77d9-4cbc-a8ba-781d202a6c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:15Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c13411-906b-4c88-9792-0f7f22ae562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c13411-906b-4c88-9792-0f7f22ae562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb68b93-13fe-46da-8115-ed1262aa2a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb68b93-13fe-46da-8115-ed1262aa2a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f5ee39-77d9-4cbc-a8ba-781d202a6c41', 'volume_name': 'volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd6915a-22f3-4bfa-aa5f-269fc693931c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dd6915a-22f3-4bfa-aa5f-269fc693931c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b220181-0fd4-40ed-bc32-677e54b4eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume c8f5ee39-77d9-4cbc-a8ba-781d202a6c41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41', 'volume_size': 1}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Created reservations ['f3c00b34-dd27-4acb-9f42-ca1ecdfae7ba', '2ecc0af9-7cf9-42df-b0cb-6f6b7d8f3e0a', '9ec29950-ce14-4e8a-80f1-8c65898f4e55', '442523ff-0a0f-4398-976f-aa9d65d5afc6'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:15 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0 1073741824" returned: 0 in 0.833s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:15 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0
Nov 05 04:35:15 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:15 devstack sudo[106768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:15 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (7c41b21a-55c1-43f5-b02b-ea672b4069ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337301dc-9ec2-4fd4-afc5-ad174a169c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (337301dc-9ec2-4fd4-afc5-ad174a169c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-854067762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ce28dd-faf0-400e-b930-7590dc3294cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:16Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e864d033-6578-4c04-8261-099da1ab9ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e864d033-6578-4c04-8261-099da1ab9ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1451bb28-d72e-4ff1-b4cc-c7a6fb4bbe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1451bb28-d72e-4ff1-b4cc-c7a6fb4bbe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ce28dd-faf0-400e-b930-7590dc3294cb', 'volume_name': 'volume-b1ce28dd-faf0-400e-b930-7590dc3294cb', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3a8913-f157-4297-8f62-08de8ca18eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3a8913-f157-4297-8f62-08de8ca18eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e46773-c208-4eb1-8a3d-3eecc78282ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:15 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume b1ce28dd-faf0-400e-b930-7590dc3294cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ce28dd-faf0-400e-b930-7590dc3294cb', 'volume_size': 1}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:15 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.451s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:15 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Deleted volume successfully.
Nov 05 04:35:16 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e541ed42-4059-4361-9777-c72dbe388259 tempest-ProjectReaderTests-849464089 None] Lock "cinder-f8d04bf4-5bab-4fce-8658-bcab5efc288c-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0" returned: 0 in 0.554s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903942120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f5ee39-77d9-4cbc-a8ba-781d202a6c41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:15Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Creating volume c8f5ee39-77d9-4cbc-a8ba-781d202a6c41 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:16 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5762f636-fe92-4388-a976-b6f0e23b93c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a039064-1828-481a-a9e9-d54e269db4b0', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:16 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41 1073741824
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410ab5b0-767f-4eaf-8bd6-e631f367bb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:16 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume volume-7a039064-1828-481a-a9e9-d54e269db4b0 (7a039064-1828-481a-a9e9-d54e269db4b0): created successfully
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (410ab5b0-767f-4eaf-8bd6-e631f367bb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (0d2393ad-100e-425a-98dc-f1cf519d2ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9a5d010e-6649-4688-8e58-d443d89be56a tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created volume successfully.
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (3fdaa224-14a1-41f3-a255-0895a0a436a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd60df7-2269-4752-800f-39a532ee1f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd60df7-2269-4752-800f-39a532ee1f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196684405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d25a1b-b508-439b-be21-a2fdb46c8284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:16Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32056e0-1674-4264-ab29-443f42b6018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b32056e0-1674-4264-ab29-443f42b6018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c080439-35c8-475e-a37e-6070c3fd68a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c080439-35c8-475e-a37e-6070c3fd68a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d25a1b-b508-439b-be21-a2fdb46c8284', 'volume_name': 'volume-c3d25a1b-b508-439b-be21-a2fdb46c8284', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acf1c3c-22c0-441a-81b6-9cfcd746e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acf1c3c-22c0-441a-81b6-9cfcd746e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3946b5-4688-4d16-9f3e-b26e89137fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume c3d25a1b-b508-439b-be21-a2fdb46c8284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d25a1b-b508-439b-be21-a2fdb46c8284', 'volume_size': 1}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:16 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41 1073741824" returned: 0 in 0.602s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:16 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41
Nov 05 04:35:16 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Flow 'volume_create_manager' (a70625f4-c272-4d5b-9a85-be71bf0ce07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63269f3f-19d5-441c-8b96-433e38fff577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63269f3f-19d5-441c-8b96-433e38fff577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-476647048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3237a48-5b4d-482b-aef7-a96a9851e05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d737fc1007840ac8093e87c5d341b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:17Z,use_quota=True,user_id='0c101ec250b848c69740c5e829e7a42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a663a74-a55b-44b5-a24a-5dd962840372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a663a74-a55b-44b5-a24a-5dd962840372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53868ff-8cbf-4e25-8c6b-bc05be11c7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53868ff-8cbf-4e25-8c6b-bc05be11c7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3237a48-5b4d-482b-aef7-a96a9851e05e', 'volume_name': 'volume-e3237a48-5b4d-482b-aef7-a96a9851e05e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39af559c-0bb8-4792-ab37-0daad10123ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39af559c-0bb8-4792-ab37-0daad10123ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e10175-1a59-4059-8c95-caecd44ccc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Volume e3237a48-5b4d-482b-aef7-a96a9851e05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3237a48-5b4d-482b-aef7-a96a9851e05e', 'volume_size': 1}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (bc054eb3-4f88-4f09-9e22-c663f96f7952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff47a74-bf05-42ed-9eab-bcd9a1bf8dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ff47a74-bf05-42ed-9eab-bcd9a1bf8dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045442491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530e91ac-348e-4c80-84a3-ea3dde21e644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:17Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6942e8-1570-42f6-bed7-2f2a9319f471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6942e8-1570-42f6-bed7-2f2a9319f471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125306a2-4d2e-407f-b2ff-e26112e4bba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125306a2-4d2e-407f-b2ff-e26112e4bba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530e91ac-348e-4c80-84a3-ea3dde21e644', 'volume_name': 'volume-530e91ac-348e-4c80-84a3-ea3dde21e644', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa939bd-682a-415d-96d7-fd96d3548a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa939bd-682a-415d-96d7-fd96d3548a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bbaa34-d4f7-4297-9913-906251fdb86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume 530e91ac-348e-4c80-84a3-ea3dde21e644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530e91ac-348e-4c80-84a3-ea3dde21e644', 'volume_size': 1}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41" returned: 0 in 0.460s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-854067762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ce28dd-faf0-400e-b930-7590dc3294cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:16Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Creating volume b1ce28dd-faf0-400e-b930-7590dc3294cb {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:17 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b220181-0fd4-40ed-bc32-677e54b4eb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack sudo[106782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb 1073741824
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb3f557-5824-4353-9f4d-2c4ac11b7055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41 (c8f5ee39-77d9-4cbc-a8ba-781d202a6c41): created successfully
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb3f557-5824-4353-9f4d-2c4ac11b7055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (9bba8a72-6a6a-4266-8385-fdf50eb8f178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (8e74536b-961e-4f68-801a-757f6b7dddf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672c111b-9199-4fa9-8697-31e06a3b52eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672c111b-9199-4fa9-8697-31e06a3b52eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373350265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf64265d-a9b9-4a75-bc39-31a1711a7ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:17Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3538383-8a94-44d5-8a8b-9f691f0d270b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3538383-8a94-44d5-8a8b-9f691f0d270b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5442db-9a02-49e2-a80f-68236c52d54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f5442db-9a02-49e2-a80f-68236c52d54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf64265d-a9b9-4a75-bc39-31a1711a7ccc', 'volume_name': 'volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d02735-636a-414f-9136-8bc03be217c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d02735-636a-414f-9136-8bc03be217c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a786bacc-fe08-4eb3-8afe-781c732a76fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Volume cf64265d-a9b9-4a75-bc39-31a1711a7ccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc', 'volume_size': 1}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-185c4f94-7f71-4670-a443-e5211a36f150 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created volume successfully.
Nov 05 04:35:17 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb 1073741824" returned: 0 in 0.478s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:17 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb
Nov 05 04:35:17 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:17 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.653s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196684405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d25a1b-b508-439b-be21-a2fdb46c8284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:16Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Creating volume c3d25a1b-b508-439b-be21-a2fdb46c8284 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:18 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e46773-c208-4eb1-8a3d-3eecc78282ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ce28dd-faf0-400e-b930-7590dc3294cb', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dfaa9b-54e5-499c-ad56-57d15cb23a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:18 devstack sudo[106797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284 1073741824
Nov 05 04:35:18 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume volume-b1ce28dd-faf0-400e-b930-7590dc3294cb (b1ce28dd-faf0-400e-b930-7590dc3294cb): created successfully
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dfaa9b-54e5-499c-ad56-57d15cb23a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (7c41b21a-55c1-43f5-b02b-ea672b4069ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9122375e-8a9a-4d06-ac90-37c2c89b633f tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created volume successfully.
Nov 05 04:35:18 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284 1073741824" returned: 0 in 0.475s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:18 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284
Nov 05 04:35:18 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:18 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-476647048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3237a48-5b4d-482b-aef7-a96a9851e05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d737fc1007840ac8093e87c5d341b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:17Z,use_quota=True,user_id='0c101ec250b848c69740c5e829e7a42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Creating volume e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:18 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3946b5-4688-4d16-9f3e-b26e89137fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d25a1b-b508-439b-be21-a2fdb46c8284', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:18 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e 1073741824
Nov 05 04:35:18 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a00c9-1d4f-453d-a046-604f5252294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:18 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume volume-c3d25a1b-b508-439b-be21-a2fdb46c8284 (c3d25a1b-b508-439b-be21-a2fdb46c8284): created successfully
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (414a00c9-1d4f-453d-a046-604f5252294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:18 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (3fdaa224-14a1-41f3-a255-0895a0a436a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-79ecf761-8e35-4a23-a6f0-f59a7bb23339 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created volume successfully.
Nov 05 04:35:19 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e 1073741824" returned: 0 in 0.481s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:19 devstack sudo[106812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e
Nov 05 04:35:19 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:19 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.408s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2045442491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530e91ac-348e-4c80-84a3-ea3dde21e644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c4912c646ac485e9d2895a8f83dae44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:17Z,use_quota=True,user_id='bf2d8b4318f34df3b97b10cf51b56450',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Creating volume 530e91ac-348e-4c80-84a3-ea3dde21e644 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:19 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e10175-1a59-4059-8c95-caecd44ccc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3237a48-5b4d-482b-aef7-a96a9851e05e', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:19 devstack sudo[106815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644 1073741824
Nov 05 04:35:19 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ef5a6e-a09f-4317-8c62-83321feb2c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Volume volume-e3237a48-5b4d-482b-aef7-a96a9851e05e (e3237a48-5b4d-482b-aef7-a96a9851e05e): created successfully
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ef5a6e-a09f-4317-8c62-83321feb2c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Flow 'volume_create_manager' (a70625f4-c272-4d5b-9a85-be71bf0ce07c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:19 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5731a105-5fcb-473f-9db4-f981c8360014 tempest-VolumeDependencyTests-1774775530 None] Created volume successfully.
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:20 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644 1073741824" returned: 0 in 0.630s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:20 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644
Nov 05 04:35:20 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:20 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.165s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-373350265',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf64265d-a9b9-4a75-bc39-31a1711a7ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:17Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Creating volume cf64265d-a9b9-4a75-bc39-31a1711a7ccc {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:20 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:20 devstack sudo[106825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc 1073741824
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0bbaa34-d4f7-4297-9913-906251fdb86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530e91ac-348e-4c80-84a3-ea3dde21e644', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:20 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507a38e0-3c60-4546-9030-524b19344ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:20 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Volume volume-530e91ac-348e-4c80-84a3-ea3dde21e644 (530e91ac-348e-4c80-84a3-ea3dde21e644): created successfully
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507a38e0-3c60-4546-9030-524b19344ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Flow 'volume_create_manager' (bc054eb3-4f88-4f09-9e22-c663f96f7952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0d751c14-4a23-4234-a8df-f749d410ef20 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created volume successfully.
Nov 05 04:35:20 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc 1073741824" returned: 0 in 0.459s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:21 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc
Nov 05 04:35:21 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-530e91ac-348e-4c80-84a3-ea3dde21e644-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:21 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.170s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-530e91ac-348e-4c80-84a3-ea3dde21e644-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Creating offline snapshot 501661ae-b7af-404a-adbd-215e17407e0f of volume e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a786bacc-fe08-4eb3-8afe-781c732a76fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a95e9b0-bd38-42c8-b5cd-d8fcff03fbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f12290-9f26-444a-829d-2c2dd8223cac]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Volume volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc (cf64265d-a9b9-4a75-bc39-31a1711a7ccc): created successfully
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a95e9b0-bd38-42c8-b5cd-d8fcff03fbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (8e74536b-961e-4f68-801a-757f6b7dddf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-quobyte-530e91ac-348e-4c80-84a3-ea3dde21e644" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-95420672-8473-4686-ad7e-bf14ebafe56a tempest-ProjectReaderTests-849464089 None] Created volume successfully.
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-530e91ac-348e-4c80-84a3-ea3dde21e644" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed31346-3b13-423e-af05-6bd92ebe1857]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:21 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e
Nov 05 04:35:21 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:21 devstack sudo[106834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644
Nov 05 04:35:21 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:21 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:21 devstack sudo[106842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f 1G
Nov 05 04:35:21 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:21 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:21 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644
Nov 05 04:35:21 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:22 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-530e91ac-348e-4c80-84a3-ea3dde21e644" returned: 0 in 0.275s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-530e91ac-348e-4c80-84a3-ea3dde21e644" released by "delete_volume" :: held 0.730s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created reservations ['9219fcc8-f169-445d-901d-3a432573672a', 'af07fa4b-c0de-45cd-8df9-052516782f09', '5a607515-f1c4-42fc-8c1c-c71b3b63d8c7', '574cfd49-d1e2-4c4d-944c-3f68d31d3b15'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:22 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f 1G" returned: 0 in 0.467s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3237a48-5b4d-482b-aef7-a96a9851e05e -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:22 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3237a48-5b4d-482b-aef7-a96a9851e05e -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f
Nov 05 04:35:22 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:22 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:22 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-c3d25a1b-b508-439b-be21-a2fdb46c8284-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-c3d25a1b-b508-439b-be21-a2fdb46c8284-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-quobyte-c3d25a1b-b508-439b-be21-a2fdb46c8284" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:22 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-c3d25a1b-b508-439b-be21-a2fdb46c8284" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3237a48-5b4d-482b-aef7-a96a9851e05e -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:22 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f is being set with open permissions: ugo+rw
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:22 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1d174f-d4ec-473e-9c5b-a26745b882ef]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:22 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f
Nov 05 04:35:22 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.442s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:22 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Deleted volume successfully.
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-48da14a5-73c0-436d-bebf-dcad61afd75c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-530e91ac-348e-4c80-84a3-ea3dde21e644-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:22 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284
Nov 05 04:35:22 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:22 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:23 devstack sudo[106866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.info
Nov 05 04:35:23 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:23 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:23 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284
Nov 05 04:35:23 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:23 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.info" returned: 0 in 0.277s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:23 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.info is being set with open permissions: ugo+rw
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:23 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.info
Nov 05 04:35:23 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:23 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c3d25a1b-b508-439b-be21-a2fdb46c8284" returned: 0 in 0.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-c3d25a1b-b508-439b-be21-a2fdb46c8284" released by "delete_volume" :: held 0.790s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created reservations ['39e26a20-0c01-4ced-a8d3-cc3316c5b646', '19b30267-db10-4a0d-8a46-08093683d05d', 'bf16d5e4-2893-48cc-9e9d-9affd64da784', 'e3e9ad1f-6d01-4de9-8939-495ef6f130d5'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:23 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.info" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.816s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Creating offline snapshot 4000a906-2837-4f45-947d-9972b7e7057b of volume cf64265d-a9b9-4a75-bc39-31a1711a7ccc {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd58876-b42f-4265-a7b7-11a6fc555d6d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0c6c4413-8e3f-48a0-9dab-4feddcc54f91 tempest-VolumeDependencyTests-1774775530 None] Create snapshot completed successfully
Nov 05 04:35:23 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:23 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:23 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc
Nov 05 04:35:23 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-b1ce28dd-faf0-400e-b930-7590dc3294cb-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-b1ce28dd-faf0-400e-b930-7590dc3294cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-quobyte-b1ce28dd-faf0-400e-b930-7590dc3294cb" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-b1ce28dd-faf0-400e-b930-7590dc3294cb" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:23 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f05b7b-9ada-40c4-8193-6225ecf169bb]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.369s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:24 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Deleted volume successfully.
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-e8d3eba4-2305-4f06-a777-5d67dc89af8c tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-c3d25a1b-b508-439b-be21-a2fdb46c8284-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:24 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" returned: 0 in 0.469s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:24 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb
Nov 05 04:35:24 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:24 devstack sudo[106888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b 1G
Nov 05 04:35:24 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:24 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:24 devstack sudo[106898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb
Nov 05 04:35:24 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:24 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b 1G" returned: 0 in 0.572s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:24 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b
Nov 05 04:35:24 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:24 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-b1ce28dd-faf0-400e-b930-7590dc3294cb" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-b1ce28dd-faf0-400e-b930-7590dc3294cb" released by "delete_volume" :: held 0.889s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:24 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created reservations ['a3c9ced3-62b3-47b1-9aea-b80a7894b7a4', 'ffad3fe9-edf7-4eb4-b7c3-bf38f102eae4', 'f483a01b-ae86-4b4b-9e62-0ffeb94acca3', '45c72934-158d-451a-8998-165ffd2a1b0d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:25 devstack sudo[106905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:25 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Flow 'volume_create_manager' (ba01adbe-44c5-473f-9ba2-7e1d31bb79dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d210c6-1d3a-44a4-98d9-8dcbd9553a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:25 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d210c6-1d3a-44a4-98d9-8dcbd9553a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-852120750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589ba6b0-442c-4c19-b7df-fce9f8ac42fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d737fc1007840ac8093e87c5d341b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=501661ae-b7af-404a-adbd-215e17407e0f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:25Z,use_quota=True,user_id='0c101ec250b848c69740c5e829e7a42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9293dd-d8e2-4992-a9a8-f378892dc6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9293dd-d8e2-4992-a9a8-f378892dc6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b528b8a3-5ab2-44be-a0d5-d0ea7d241aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b528b8a3-5ab2-44be-a0d5-d0ea7d241aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '589ba6b0-442c-4c19-b7df-fce9f8ac42fb', 'volume_name': 'volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb', 'volume_size': 1, 'snapshot_id': '501661ae-b7af-404a-adbd-215e17407e0f'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d11f0b2-5f4a-4db5-a509-1a16685a519c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d11f0b2-5f4a-4db5-a509-1a16685a519c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80107cb-bbda-4315-8524-416a742c225f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:25 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Volume 589ba6b0-442c-4c19-b7df-fce9f8ac42fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb', 'volume_size': 1, 'snapshot_id': '501661ae-b7af-404a-adbd-215e17407e0f'}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b" returned: 0 in 0.541s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:25 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b is being set with open permissions: ugo+rw
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:25 devstack sudo[106909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b
Nov 05 04:35:25 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-quobyte-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:25 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:25 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Deleted volume successfully.
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6df7321-62f1-42bd-b90b-69f2a20f30a2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-61a0653c-330a-4d71-a484-7e98d253dce7 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-b1ce28dd-faf0-400e-b930-7590dc3294cb-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:25 devstack sudo[106912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41
Nov 05 04:35:25 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:25 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b" returned: 0 in 0.291s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:25 devstack sudo[106915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.info
Nov 05 04:35:25 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:25 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41" returned: 0 in 0.452s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:25 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41
Nov 05 04:35:25 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:25 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.info" returned: 0 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:25 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.info is being set with open permissions: ugo+rw
Nov 05 04:35:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:25 devstack sudo[106923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.info
Nov 05 04:35:25 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:26 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41" returned: 0 in 0.296s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41" released by "delete_volume" :: held 0.805s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:26 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.info" returned: 0 in 0.280s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created reservations ['c8ee1b02-cbcc-4d2a-9a00-684f7fe2a799', '882cf345-b6e9-4620-8c83-c216180cdb9d', '50b1c8d5-5294-466a-8b81-3988941333aa', 'e74bc71a-f65e-4a14-b6ba-f815ef2d330d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.944s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "cinder-quobyte-501661ae-b7af-404a-adbd-215e17407e0f-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-501661ae-b7af-404a-adbd-215e17407e0f-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Creating volume 589ba6b0-442c-4c19-b7df-fce9f8ac42fb from snapshot 501661ae-b7af-404a-adbd-215e17407e0f {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "cinder-quobyte-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a1c3ba92-0248-46ff-b97f-d2f78cdfb76d tempest-ProjectReaderTests-849464089 None] Create snapshot completed successfully
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] snapshot: 501661ae-b7af-404a-adbd-215e17407e0f, volume: 589ba6b0-442c-4c19-b7df-fce9f8ac42fb,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b5ae81-e03c-4c34-8c5b-b4c615ae78c3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:26 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:26 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:26 devstack sudo[106927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f
Nov 05 04:35:26 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:26 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Deleted volume successfully.
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-246eb8d1-0eab-4893-be3e-b588ca0e6735 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-c8f5ee39-77d9-4cbc-a8ba-781d202a6c41-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:26 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3237a48-5b4d-482b-aef7-a96a9851e05e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bbc474-ed5d-4acd-b414-65b535fcea2d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:26 devstack sudo[106935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e
Nov 05 04:35:26 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-4000a906-2837-4f45-947d-9972b7e7057b-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Lock "cinder-4000a906-2837-4f45-947d-9972b7e7057b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-4000a906-2837-4f45-947d-9972b7e7057b" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-4000a906-2837-4f45-947d-9972b7e7057b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Deleting offline snapshot 4000a906-2837-4f45-947d-9972b7e7057b of volume cf64265d-a9b9-4a75-bc39-31a1711a7ccc {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] snapshot_file for this snap is: volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[851c65ee-7861-44f0-bd04-a20c38c0f1c2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:27 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e" returned: 0 in 0.377s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:27 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb
Nov 05 04:35:27 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:27 devstack sudo[106940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b
Nov 05 04:35:27 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-7a039064-1828-481a-a9e9-d54e269db4b0-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-7a039064-1828-481a-a9e9-d54e269db4b0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-quobyte-7a039064-1828-481a-a9e9-d54e269db4b0" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:27 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b" returned: 0 in 0.396s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-7a039064-1828-481a-a9e9-d54e269db4b0" acquired by "delete_volume" :: waited 0.037s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[46db7fb3-147b-4a7c-b102-5aec3f7a8a0e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15f8465-79dc-48b8-9ac3-b475e5bbe483]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:27 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc
Nov 05 04:35:27 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:27 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0
Nov 05 04:35:27 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:27 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" returned: 0 in 0.500s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:28 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0" returned: 0 in 0.524s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:28 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b
Nov 05 04:35:28 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:28 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0
Nov 05 04:35:28 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:28 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7a039064-1828-481a-a9e9-d54e269db4b0" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-7a039064-1828-481a-a9e9-d54e269db4b0" released by "delete_volume" :: held 0.977s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created reservations ['071bffbf-07c1-43c2-bdbf-19137b7667cb', '4a66bb8a-984b-4a3d-a3e8-4ad0b1f6f4db', '23d8101a-1e3e-44d9-a837-5b0dac7bb71b', '03e3b598-a449-4385-aa30-9894392faa1e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:28 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b" returned: 0 in 0.701s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:28 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:28 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:28 devstack sudo[106977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b
Nov 05 04:35:28 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:29 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc.4000a906-2837-4f45-947d-9972b7e7057b" returned: 0 in 0.382s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:35:29 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.518s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-4000a906-2837-4f45-947d-9972b7e7057b" released by "_delete_snapshot" :: held 2.198s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" released by "delete_snapshot" :: held 2.240s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:29 devstack sudo[106982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:29 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Deleted volume successfully.
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2fc9f615-74d5-46c1-b0df-49f0a8b9d051 tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-7a039064-1828-481a-a9e9-d54e269db4b0-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Created reservations ['c3c612b0-c0d5-4031-8f37-5d172d03771d', 'b3cb629f-5ef0-4553-9342-82c8f6d81b69', 'f9ab3324-3331-47cc-8186-0569d3eb91f6', 'f0dcb67d-8e8a-4ab3-8cb2-cdc295b95078'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Delete snapshot completed successfully.
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ddd7e0b3-1f45-4d31-a7c7-e7c9d299e34d tempest-ProjectReaderTests-849464089 None] Lock "cinder-4000a906-2837-4f45-947d-9972b7e7057b-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:29 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.560s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-ec1bebd9-0cc1-4414-ac18-d9913876db30-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-ec1bebd9-0cc1-4414-ac18-d9913876db30-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "cinder-quobyte-ec1bebd9-0cc1-4414-ac18-d9913876db30" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-ec1bebd9-0cc1-4414-ac18-d9913876db30" acquired by "delete_volume" :: waited 0.028s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[042e45fb-030d-4c4b-b839-72431b85f76e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:30 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30
Nov 05 04:35:30 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-cf64265d-a9b9-4a75-bc39-31a1711a7ccc-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-cf64265d-a9b9-4a75-bc39-31a1711a7ccc-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:30 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:30 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[58acdc5a-bc79-4d79-a60c-f45f7700e024]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:30 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30" returned: 0 in 0.740s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:30 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:30 devstack sudo[106992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc
Nov 05 04:35:30 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:30 devstack sudo[106993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30
Nov 05 04:35:30 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:31 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" returned: 0 in 0.578s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:31 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc
Nov 05 04:35:31 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:31 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-ec1bebd9-0cc1-4414-ac18-d9913876db30" returned: 0 in 0.555s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-quobyte-ec1bebd9-0cc1-4414-ac18-d9913876db30" released by "delete_volume" :: held 1.385s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Created reservations ['54713080-4b41-4b4d-8317-52a7ebe5ce34', '65c0cd65-2108-417f-abdc-930294285c41', 'f85ec5ce-d979-44f2-bd74-8ff0c241a694', 'a4386976-8184-4775-8c3b-cc24ee530b3b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:31 devstack sudo[107003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:31 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:31 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" returned: 0 in 0.550s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-cf64265d-a9b9-4a75-bc39-31a1711a7ccc" released by "delete_volume" :: held 1.258s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Created reservations ['4a135daf-efe3-4192-ba8b-012ccdf17d69', 'a5667165-292a-4527-815d-4ec1a5e59c22', '5d37a226-616c-4cd1-8e91-409f0b9ab7e0', 'ddacc17b-9b76-4490-b3ba-70b9191f6344'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:32 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:32 devstack sudo[107007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:32 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:32 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.559s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:32 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Deleted volume successfully.
Nov 05 04:35:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-17c8df2b-3d36-4257-b9eb-ab2f9a00e83d tempest-CreateVolumesFromSourceVolumeTest-98072296 None] Lock "cinder-ec1bebd9-0cc1-4414-ac18-d9913876db30-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:32 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:32 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:32 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Deleted volume successfully.
Nov 05 04:35:32 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cfac1f1f-ee98-4518-9da1-f3d797d314e5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-cf64265d-a9b9-4a75-bc39-31a1711a7ccc-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:33 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (a26ab976-85e3-4ac8-8acc-d32e8c15fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f106ce2-42ae-489c-af56-bed842ca2de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f106ce2-42ae-489c-af56-bed842ca2de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422174935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392caf0c-8d39-44bf-8d1f-84edb2725601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:34Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa7799a-445d-4104-8a77-10fb389f59b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa7799a-445d-4104-8a77-10fb389f59b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d784f8-01fd-480e-ac1b-c77b74226b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:33 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d784f8-01fd-480e-ac1b-c77b74226b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '392caf0c-8d39-44bf-8d1f-84edb2725601', 'volume_name': 'volume-392caf0c-8d39-44bf-8d1f-84edb2725601', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47121220-84d0-42de-97a1-68765d643ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47121220-84d0-42de-97a1-68765d643ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:34 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e71d36-8de3-4474-b9bd-bac93543af79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:34 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Volume 392caf0c-8d39-44bf-8d1f-84edb2725601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-392caf0c-8d39-44bf-8d1f-84edb2725601', 'volume_size': 1}
Nov 05 04:35:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:35 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" returned: 0 in 7.952s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:35:35 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Converted 1024.00 MB image at 128.76 MB/s
Nov 05 04:35:35 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb is being set with open permissions: ugo+rw
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:35 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb
Nov 05 04:35:35 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:35 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" released by "_copy_volume_from_snapshot" :: held 9.056s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-501661ae-b7af-404a-adbd-215e17407e0f-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" released by "_create_volume_from_snapshot" :: held 9.135s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.169s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422174935',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=392caf0c-8d39-44bf-8d1f-84edb2725601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d107ae1525749828843d32f09bfea66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:34Z,use_quota=True,user_id='5c9a67495c714b48b5479110c780f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Creating volume 392caf0c-8d39-44bf-8d1f-84edb2725601 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:35 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:35 devstack sudo[107014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601 1073741824
Nov 05 04:35:35 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80107cb-bbda-4315-8524-416a742c225f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb', 'volume_size': 1, 'snapshot_id': '501661ae-b7af-404a-adbd-215e17407e0f'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a4b708-6476-4fc9-abd1-57a2dc0da2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:35 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Volume volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb (589ba6b0-442c-4c19-b7df-fce9f8ac42fb): created successfully
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a4b708-6476-4fc9-abd1-57a2dc0da2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Flow 'volume_create_manager' (ba01adbe-44c5-473f-9ba2-7e1d31bb79dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-9c73d9a4-7139-4a2c-9353-a67d2b952045 tempest-VolumeDependencyTests-1774775530 None] Created volume successfully.
Nov 05 04:35:35 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601 1073741824" returned: 0 in 0.505s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:35 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601
Nov 05 04:35:35 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "cinder-501661ae-b7af-404a-adbd-215e17407e0f-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-501661ae-b7af-404a-adbd-215e17407e0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "cinder-quobyte-e3237a48-5b4d-482b-aef7-a96a9851e05e" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-e3237a48-5b4d-482b-aef7-a96a9851e05e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "cinder-quobyte-501661ae-b7af-404a-adbd-215e17407e0f" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-501661ae-b7af-404a-adbd-215e17407e0f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Deleting offline snapshot 501661ae-b7af-404a-adbd-215e17407e0f of volume e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] snapshot_file for this snap is: volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cb407e-3424-4e60-962c-432c61039388]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:36 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601" returned: 0 in 0.304s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=241,cinder:UPDATE=317,cinder:INSERT=74,cinder:DELETE=27 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e71d36-8de3-4474-b9bd-bac93543af79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-392caf0c-8d39-44bf-8d1f-84edb2725601', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec75528-0b2b-4030-8d4e-2ed1a6bdb0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:36 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Volume volume-392caf0c-8d39-44bf-8d1f-84edb2725601 (392caf0c-8d39-44bf-8d1f-84edb2725601): created successfully
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec75528-0b2b-4030-8d4e-2ed1a6bdb0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Flow 'volume_create_manager' (a26ab976-85e3-4ac8-8acc-d32e8c15fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:36 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c54943ba-6ef7-4e7c-8515-062c4e209ba3 tempest-ProjectReaderTests-849464089 None] Created volume successfully.
Nov 05 04:35:36 devstack sudo[107058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f
Nov 05 04:35:36 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:36 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3237a48-5b4d-482b-aef7-a96a9851e05e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d18db14-94b3-4a6c-8602-4077150d2035]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:36 devstack sudo[107064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e
Nov 05 04:35:36 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=222,cinder:UPDATE=319,cinder:INSERT=90,cinder:DELETE=30 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Creating offline snapshot e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 of volume 392caf0c-8d39-44bf-8d1f-84edb2725601 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[73378b0e-8bdd-41f0-863f-4df25ae847e6]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:37 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601
Nov 05 04:35:37 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:37 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e" returned: 0 in 0.619s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:37 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f
Nov 05 04:35:37 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:37 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601" returned: 0 in 0.406s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:37 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 1G
Nov 05 04:35:37 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:37 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f" returned: 0 in 0.368s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:37 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f
Nov 05 04:35:37 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:37 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e.501661ae-b7af-404a-adbd-215e17407e0f" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-501661ae-b7af-404a-adbd-215e17407e0f" released by "_delete_snapshot" :: held 1.799s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-e3237a48-5b4d-482b-aef7-a96a9851e05e" released by "delete_snapshot" :: held 1.828s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:37 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 1G" returned: 0 in 0.473s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392caf0c-8d39-44bf-8d1f-84edb2725601 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:37 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392caf0c-8d39-44bf-8d1f-84edb2725601 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2
Nov 05 04:35:37 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Created reservations ['0c030a82-8838-48a8-ae08-4ab3ab80e101', '0b2d55fd-43ba-44a6-aa87-504b7c1dc83b', 'b6f8878c-75ce-4297-9109-72cc9cd48dcb', '3f974ec3-e252-41f1-850a-d96425316a22'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:38 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Delete snapshot completed successfully.
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-432dc2ae-27f6-4f3a-897e-3f4d8935dd28 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-501661ae-b7af-404a-adbd-215e17407e0f-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "cinder-e3237a48-5b4d-482b-aef7-a96a9851e05e-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-e3237a48-5b4d-482b-aef7-a96a9851e05e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:38 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-392caf0c-8d39-44bf-8d1f-84edb2725601 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2" returned: 0 in 0.335s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:38 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 is being set with open permissions: ugo+rw
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:38 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2
Nov 05 04:35:38 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "cinder-quobyte-e3237a48-5b4d-482b-aef7-a96a9851e05e" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-e3237a48-5b4d-482b-aef7-a96a9851e05e" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7fb3f2-6f22-4a19-a82d-cae00f847ae9]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:38 devstack sudo[107099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e
Nov 05 04:35:38 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:38 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:38 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.info
Nov 05 04:35:38 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:38 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:38 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e
Nov 05 04:35:38 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:38 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.info" returned: 0 in 0.301s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:38 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.info is being set with open permissions: ugo+rw
Nov 05 04:35:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:38 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.info
Nov 05 04:35:38 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:39 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-e3237a48-5b4d-482b-aef7-a96a9851e05e" returned: 0 in 0.293s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-e3237a48-5b4d-482b-aef7-a96a9851e05e" released by "delete_volume" :: held 0.789s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:39 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Created reservations ['38479f94-cb0f-45d4-8976-2ec799fa3ea7', '8e283adb-9a80-4017-8cfe-81954549988f', '805eb9cd-ce35-47b0-b6a7-98f556db5f13', 'f465c9f9-a3e5-4ead-ac43-87cfe8ea0c19'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.info" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.171s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bdfae32e-eace-4e2d-a525-b7d5aaeefd07 tempest-ProjectReaderTests-849464089 None] Create snapshot completed successfully
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:39 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:39 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "cinder-589ba6b0-442c-4c19-b7df-fce9f8ac42fb-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-589ba6b0-442c-4c19-b7df-fce9f8ac42fb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Flow 'volume_create_manager' (cff441db-94b4-421b-8a27-0e706f9772f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b06452-7678-44d4-8f1f-7a7a48914010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b06452-7678-44d4-8f1f-7a7a48914010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f60311-4f4d-43e1-af93-2a0e57d93ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507014f7bfd041bb82c744ac7416801b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:39Z,use_quota=True,user_id='e1c08f3bf53246dba375dec7291716f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323c2574-4607-41c7-9e4e-0c6c0b9c5f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323c2574-4607-41c7-9e4e-0c6c0b9c5f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29576db-9b90-440d-ad80-300b3f1b50ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.image.glance [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Creating Keystone auth plugin from conf {{(pid=87166) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "cinder-quobyte-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:39 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.293s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Deleted volume successfully.
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[54726f75-7401-45b2-8ea9-d9ec5d8eefa3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2d61ff10-15d0-4f64-9638-e81e14a79442 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-e3237a48-5b4d-482b-aef7-a96a9851e05e-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:39 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb
Nov 05 04:35:39 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29576db-9b90-440d-ad80-300b3f1b50ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79f60311-4f4d-43e1-af93-2a0e57d93ef7', 'volume_name': 'volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7', 'volume_size': 1, 'image_id': 'fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf58af57e92cc61554cc75686063ef02', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '507014f7bfd041bb82c744ac7416801b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a52e7f60b137ebc5d23c317e34509a4e1a6fc25aa9e062f1b7e949254d622dd419febfc2fcd1980b4bc38d3116f4c5c8824522580ffdcad433bcdbbf50373754', 'id': 'fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'created_at': datetime.datetime(2026, 11, 5, 3, 35, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 35, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fde809f0-b8f1-4afa-95ee-f4c10669d24e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7e28590>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de874a92-e68f-4504-9fb1-1f21a03d8477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de874a92-e68f-4504-9fb1-1f21a03d8477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139096f9-b51d-4d9e-bcaf-8db2c7a40780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Volume 79f60311-4f4d-43e1-af93-2a0e57d93ef7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7', 'volume_size': 1, 'image_id': 'fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf58af57e92cc61554cc75686063ef02', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '507014f7bfd041bb82c744ac7416801b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a52e7f60b137ebc5d23c317e34509a4e1a6fc25aa9e062f1b7e949254d622dd419febfc2fcd1980b4bc38d3116f4c5c8824522580ffdcad433bcdbbf50373754', 'id': 'fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'created_at': datetime.datetime(2026, 11, 5, 3, 35, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 35, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fde809f0-b8f1-4afa-95ee-f4c10669d24e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7e28590>}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Trying to clone 79f60311-4f4d-43e1-af93-2a0e57d93ef7 from image fde809f0-b8f1-4afa-95ee-f4c10669d24e at location (None, [{'url': 'file:///opt/stack/data/glance/images/fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'metadata': {}}]). {{(pid=87166) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 05 04:35:39 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Image download 0.00 MB at 0.00 MB/s
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dafd92-7dba-409b-949f-4da9a9268d78]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:40 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" returned: 0 in 0.401s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:40 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb
Nov 05 04:35:40 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:40 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD
Nov 05 04:35:40 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-392caf0c-8d39-44bf-8d1f-84edb2725601" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-392caf0c-8d39-44bf-8d1f-84edb2725601" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Deleting offline snapshot e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 of volume 392caf0c-8d39-44bf-8d1f-84edb2725601 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] snapshot_file for this snap is: volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7232ab2-807b-485c-8573-d9b33e0fb947]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:40 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:40 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-quobyte-589ba6b0-442c-4c19-b7df-fce9f8ac42fb" released by "delete_volume" :: held 0.759s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:40 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2
Nov 05 04:35:40 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Created reservations ['8418b5d9-ff1d-49b4-b951-41370d55ddb2', '364cf0f6-d54c-4633-a24c-7728f377813b', '1b9dc4ae-d691-40e6-9f53-783dcdbd1e80', '453c9b3d-d83c-47cc-9719-74e4740f5163'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:40 devstack sudo[107133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD
Nov 05 04:35:40 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:40 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:40 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:40 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:40 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-392caf0c-8d39-44bf-8d1f-84edb2725601(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD" returned: 1 in 0.441s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Temporary image fde809f0-b8f1-4afa-95ee-f4c10669d24e is fetched for user e1c08f3bf53246dba375dec7291716f6. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d531cbe-7865-40a0-98d4-66f35236062b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:40 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.294s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:40 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Deleted volume successfully.
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f35995a2-61c5-43c6-81c3-7bdb65d7bee6 tempest-VolumeDependencyTests-1774775530 None] Lock "cinder-589ba6b0-442c-4c19-b7df-fce9f8ac42fb-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a8a9ec-ba64-4865-a2d0-909d4f773de7]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:40 devstack sudo[107146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601
Nov 05 04:35:40 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:41 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD
Nov 05 04:35:41 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:41 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601" returned: 0 in 0.405s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:41 devstack sudo[107155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2
Nov 05 04:35:41 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:41 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:41 devstack sudo[107157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD
Nov 05 04:35:41 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:41 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f60311-4f4d-43e1-af93-2a0e57d93ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='507014f7bfd041bb82c744ac7416801b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:39Z,use_quota=True,user_id='e1c08f3bf53246dba375dec7291716f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Creating volume 79f60311-4f4d-43e1-af93-2a0e57d93ef7 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:41 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:41 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2" returned: 0 in 0.443s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:41 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 1073741824
Nov 05 04:35:41 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:41 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2
Nov 05 04:35:41 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:41 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601.e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2" released by "_delete_snapshot" :: held 1.699s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:41 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-392caf0c-8d39-44bf-8d1f-84edb2725601" released by "delete_snapshot" :: held 1.733s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Created reservations ['392ce91a-26fc-493d-9547-e7e497d90240', '32dc78a5-602a-47f0-9a97-2e2c397fb850', 'f5dce132-5016-49a7-bae0-fa204f211008', '7d31d9e7-bcf7-48ba-b030-1d62f2b090ff'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Delete snapshot completed successfully.
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-181710ec-623f-4a4a-a771-44ccf45c46a5 tempest-ProjectReaderTests-849464089 None] Lock "cinder-e04cb7ce-9dab-4dd0-86b9-9cd3a79be7a2-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:42 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 1073741824" returned: 0 in 0.536s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:42 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7
Nov 05 04:35:42 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-392caf0c-8d39-44bf-8d1f-84edb2725601-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Lock "cinder-392caf0c-8d39-44bf-8d1f-84edb2725601-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Acquiring lock "cinder-quobyte-392caf0c-8d39-44bf-8d1f-84edb2725601" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:42 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-392caf0c-8d39-44bf-8d1f-84edb2725601" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7" returned: 0 in 0.345s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afd26be-0ebb-4a76-bc60-cfe7f1c1eb77]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Attempting download of fde809f0-b8f1-4afa-95ee-f4c10669d24e ((None, [{'url': 'file:///opt/stack/data/glance/images/fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'metadata': {}}])) to volume 79f60311-4f4d-43e1-af93-2a0e57d93ef7. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9b8900-adcf-4683-b870-1a4950013150]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fde809f0-b8f1-4afa-95ee-f4c10669d24e_0g_91v2k {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:42 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601
Nov 05 04:35:42 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:42 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fde809f0-b8f1-4afa-95ee-f4c10669d24e_0g_91v2k
Nov 05 04:35:42 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:42 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601" returned: 0 in 0.381s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:42 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601
Nov 05 04:35:42 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:43 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fde809f0-b8f1-4afa-95ee-f4c10669d24e_0g_91v2k" returned: 0 in 0.371s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fde809f0-b8f1-4afa-95ee-f4c10669d24e_0g_91v2k {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:43 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fde809f0-b8f1-4afa-95ee-f4c10669d24e_0g_91v2k
Nov 05 04:35:43 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:43 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-392caf0c-8d39-44bf-8d1f-84edb2725601" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Lock "cinder-quobyte-392caf0c-8d39-44bf-8d1f-84edb2725601" released by "delete_volume" :: held 0.745s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Created reservations ['6f3322af-7554-4a4c-91de-db6f64114c4e', '217d0a64-47eb-45be-ab04-1df1afb2fe31', '2dc9f8d2-0806-4db1-a268-06969a76885a', 'e49fdbf7-2543-4903-aa1a-110913765654'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:43 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fde809f0-b8f1-4afa-95ee-f4c10669d24e_0g_91v2k" returned: 1 in 0.355s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fde809f0-b8f1-4afa-95ee-f4c10669d24e_0g_91v2k' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d07e31-8f35-4491-a229-2a39c30802c1]: (4, 'raw') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:43 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:43 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:43 devstack sudo[107194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD
Nov 05 04:35:43 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:43 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.333s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:43 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Deleted volume successfully.
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-54320bc2-ced2-4f06-ad8c-731ad4de4bc6 tempest-ProjectReaderTests-849464089 None] Lock "cinder-392caf0c-8d39-44bf-8d1f-84edb2725601-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:43 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:43 devstack sudo[107200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD
Nov 05 04:35:43 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:44 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD' failed. Not Retrying. {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 05 04:35:44 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] fde809f0-b8f1-4afa-95ee-f4c10669d24e was raw, converting to qcow2 {{(pid=87166) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 05 04:35:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:44 devstack sudo[107205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7
Nov 05 04:35:44 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:44 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7" returned: 0 in 0.552s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:44 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fde809f0-b8f1-4afa-95ee-f4c10669d24e_tmr47by2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:35:44 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Converted 0.00 MB image at 0.00 MB/s
Nov 05 04:35:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:44 devstack sudo[107211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 1G
Nov 05 04:35:44 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (8248ecb7-9757-45d0-9cc8-171aa2bc94a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98378fcf-67bf-4dbc-8633-85ecdd6124ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98378fcf-67bf-4dbc-8633-85ecdd6124ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716428978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4452cb8d-e38c-4fd8-b032-67d15b79c268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:45Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b2fe48-3229-4179-bba0-99fe5b32d219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36b2fe48-3229-4179-bba0-99fe5b32d219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4b5d85-5ba3-4ad0-ad77-34c9285b6e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4b5d85-5ba3-4ad0-ad77-34c9285b6e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4452cb8d-e38c-4fd8-b032-67d15b79c268', 'volume_name': 'volume-4452cb8d-e38c-4fd8-b032-67d15b79c268', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58247452-0909-4f6c-92e8-d5c161bf8986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58247452-0909-4f6c-92e8-d5c161bf8986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:45 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9ebee5-245d-4eb4-959b-79266aef6b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Volume 4452cb8d-e38c-4fd8-b032-67d15b79c268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4452cb8d-e38c-4fd8-b032-67d15b79c268', 'volume_size': 1}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-716428978',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4452cb8d-e38c-4fd8-b032-67d15b79c268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:45Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Creating volume 4452cb8d-e38c-4fd8-b032-67d15b79c268 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:45 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 1G" returned: 0 in 0.396s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Downloaded image fde809f0-b8f1-4afa-95ee-f4c10669d24e ((None, [{'url': 'file:///opt/stack/data/glance/images/fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'metadata': {}}])) to volume 79f60311-4f4d-43e1-af93-2a0e57d93ef7 successfully. {{(pid=87166) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Temporary image fde809f0-b8f1-4afa-95ee-f4c10669d24e for user e1c08f3bf53246dba375dec7291716f6 is deleted. {{(pid=87166) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.volume_utils [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Marking volume 79f60311-4f4d-43e1-af93-2a0e57d93ef7 as bootable. {{(pid=87166) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Nov 05 04:35:45 devstack sudo[107217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 1073741824
Nov 05 04:35:45 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Copying metadata from image fde809f0-b8f1-4afa-95ee-f4c10669d24e to 79f60311-4f4d-43e1-af93-2a0e57d93ef7. {{(pid=87166) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Creating volume glance metadata for volume 79f60311-4f4d-43e1-af93-2a0e57d93ef7 backed by image fde809f0-b8f1-4afa-95ee-f4c10669d24e with: {'image_id': 'fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bf58af57e92cc61554cc75686063ef02', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87166) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139096f9-b51d-4d9e-bcaf-8db2c7a40780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7', 'volume_size': 1, 'image_id': 'fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bf58af57e92cc61554cc75686063ef02', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '507014f7bfd041bb82c744ac7416801b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a52e7f60b137ebc5d23c317e34509a4e1a6fc25aa9e062f1b7e949254d622dd419febfc2fcd1980b4bc38d3116f4c5c8824522580ffdcad433bcdbbf50373754', 'id': 'fde809f0-b8f1-4afa-95ee-f4c10669d24e', 'created_at': datetime.datetime(2026, 11, 5, 3, 35, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 3, 35, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fde809f0-b8f1-4afa-95ee-f4c10669d24e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f05e7e28590>}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5897b55c-3e32-47dc-8d63-f53104be1b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Volume volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 (79f60311-4f4d-43e1-af93-2a0e57d93ef7): created successfully
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5897b55c-3e32-47dc-8d63-f53104be1b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Flow 'volume_create_manager' (cff441db-94b4-421b-8a27-0e706f9772f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cb8f3cfb-1acc-4bcf-b2af-a2eb2cb1813c tempest-VolumeImageDependencyTests-1936605341 None] Created volume successfully.
Nov 05 04:35:45 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 1073741824" returned: 0 in 0.454s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:45 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268
Nov 05 04:35:45 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:45 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9ebee5-245d-4eb4-959b-79266aef6b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4452cb8d-e38c-4fd8-b032-67d15b79c268', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feb0ea4-26cf-44cb-afa9-7f63e639d41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Volume volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 (4452cb8d-e38c-4fd8-b032-67d15b79c268): created successfully
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5feb0ea4-26cf-44cb-afa9-7f63e639d41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (8248ecb7-9757-45d0-9cc8-171aa2bc94a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7d53714c-2e1c-4b13-97a7-c7186392c8cc tempest-ProjectMemberTests-1218408516 None] Created volume successfully.
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Acquiring lock "cinder-79f60311-4f4d-43e1-af93-2a0e57d93ef7-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Lock "cinder-79f60311-4f4d-43e1-af93-2a0e57d93ef7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Acquiring lock "cinder-quobyte-79f60311-4f4d-43e1-af93-2a0e57d93ef7" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Lock "cinder-quobyte-79f60311-4f4d-43e1-af93-2a0e57d93ef7" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7c0d22-f385-4ee7-9f2f-6dc828d660be]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:46 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7
Nov 05 04:35:46 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:46 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7" returned: 0 in 0.369s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:46 devstack sudo[107232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7
Nov 05 04:35:46 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:46 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-79f60311-4f4d-43e1-af93-2a0e57d93ef7" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Lock "cinder-quobyte-79f60311-4f4d-43e1-af93-2a0e57d93ef7" released by "delete_volume" :: held 0.670s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Created reservations ['8afce7d8-4c2f-45aa-bae8-d94153bc84d1', '375dda67-265f-467a-902d-f7a2f79c8ba1', 'f2bae737-2dd4-42d6-a2d1-094f644db741', '97b68bf8-677a-4831-9cce-b9c97c991493'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:46 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:46 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:47 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.278s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:47 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:47 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Deleted volume successfully.
Nov 05 04:35:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-f4865269-3573-4989-81de-161bc6df9f0a tempest-VolumeImageDependencyTests-1936605341 None] Lock "cinder-79f60311-4f4d-43e1-af93-2a0e57d93ef7-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Creating offline snapshot 8e3a4d52-eba6-4a3f-99cf-3c1216abac0f of volume 4452cb8d-e38c-4fd8-b032-67d15b79c268 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:35:47 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c22912-f549-450a-9d47-9e2738c26865]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:47 devstack sudo[107238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268
Nov 05 04:35:47 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:48 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268" returned: 0 in 0.368s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:48 devstack sudo[107243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f 1G
Nov 05 04:35:48 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:48 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f 1G" returned: 0 in 0.430s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:48 devstack sudo[107249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f
Nov 05 04:35:48 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:48 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f" returned: 0 in 0.346s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:48 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f is being set with open permissions: ugo+rw
Nov 05 04:35:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:48 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f
Nov 05 04:35:48 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:49 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f" returned: 0 in 0.266s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:49 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.info
Nov 05 04:35:49 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:49 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.info" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:49 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.info is being set with open permissions: ugo+rw
Nov 05 04:35:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:49 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.info
Nov 05 04:35:49 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:49 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.info" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:49 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-6d9a0d45-eae9-47e3-b7c6-4185b695c9c2 tempest-ProjectMemberTests-1218408516 None] Create snapshot completed successfully
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-8e3a4d52-eba6-4a3f-99cf-3c1216abac0f-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-8e3a4d52-eba6-4a3f-99cf-3c1216abac0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-4452cb8d-e38c-4fd8-b032-67d15b79c268" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-4452cb8d-e38c-4fd8-b032-67d15b79c268" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-8e3a4d52-eba6-4a3f-99cf-3c1216abac0f" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-8e3a4d52-eba6-4a3f-99cf-3c1216abac0f" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Deleting offline snapshot 8e3a4d52-eba6-4a3f-99cf-3c1216abac0f of volume 4452cb8d-e38c-4fd8-b032-67d15b79c268 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] snapshot_file for this snap is: volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[548a7621-342c-4f0d-bdfb-e95dcd176087]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:50 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a5166ba4-289a-4c73-951d-a4bf136da6dc tempest-ProjectAdminTests-443734849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.538516998291, 'free_capacity_gb': 1773.538516998291, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87166) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 05 04:35:50 devstack sudo[107264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f
Nov 05 04:35:50 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:51 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:51 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4452cb8d-e38c-4fd8-b032-67d15b79c268(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:35:51 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[41897326-8130-4af0-9747-2eb2df7ee3df]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:51 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268
Nov 05 04:35:51 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:51 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268" returned: 0 in 0.441s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:51 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f
Nov 05 04:35:51 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:52 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:52 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f
Nov 05 04:35:52 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:52 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268.8e3a4d52-eba6-4a3f-99cf-3c1216abac0f" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-8e3a4d52-eba6-4a3f-99cf-3c1216abac0f" released by "_delete_snapshot" :: held 1.611s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-4452cb8d-e38c-4fd8-b032-67d15b79c268" released by "delete_snapshot" :: held 1.630s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Created reservations ['74233830-cf7e-4dbb-9d46-b047ee6e9771', '9af3ba45-01cf-4665-8bd9-bc770539c38b', 'eca96c04-4f3d-40c3-87fc-9c9f915c2aa5', 'e053840d-69d9-4652-aa00-948d3ceda7cb'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Delete snapshot completed successfully.
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-5d840847-d9ef-4b57-8552-df7cd3f8df74 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-8e3a4d52-eba6-4a3f-99cf-3c1216abac0f-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-4452cb8d-e38c-4fd8-b032-67d15b79c268-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-4452cb8d-e38c-4fd8-b032-67d15b79c268-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-4452cb8d-e38c-4fd8-b032-67d15b79c268" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-4452cb8d-e38c-4fd8-b032-67d15b79c268" acquired by "delete_volume" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[988ee14f-4087-45df-ba8b-25ef9e9f186b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:53 devstack sudo[107283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268
Nov 05 04:35:53 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:53 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268" returned: 0 in 0.424s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:53 devstack sudo[107288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268
Nov 05 04:35:53 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:53 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4452cb8d-e38c-4fd8-b032-67d15b79c268" returned: 0 in 0.255s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-4452cb8d-e38c-4fd8-b032-67d15b79c268" released by "delete_volume" :: held 0.764s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Created reservations ['b8f370e7-22ff-4a8b-b7f8-ad69d4d1dc04', 'f5389d69-84ff-48d2-81e4-4d5f819bf63e', 'e1cf2e6d-a8c9-49f8-bc73-b2ffbbe183bf', '8d114c90-a69f-4acb-88bb-4a14f324b707'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:53 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:35:53 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:54 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.287s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:35:54 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Deleted volume successfully.
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fbe98639-0d19-4e68-a4e1-23fd2cc1a796 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-4452cb8d-e38c-4fd8-b032-67d15b79c268-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (d010113f-455e-4f1f-8fb2-42bdbc996f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1312dd58-3b85-4d52-8199-cfe42ed62962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1312dd58-3b85-4d52-8199-cfe42ed62962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206419373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3893b409-d326-4206-8991-b4844429653d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:55Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5b5184-4f20-43e7-a2f8-d0c605ed0d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5b5184-4f20-43e7-a2f8-d0c605ed0d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c45afa7-ec63-4b80-8e9c-e18e37d98702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c45afa7-ec63-4b80-8e9c-e18e37d98702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3893b409-d326-4206-8991-b4844429653d', 'volume_name': 'volume-3893b409-d326-4206-8991-b4844429653d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132b9a4a-e294-4ded-b2df-d4edfd8a0e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132b9a4a-e294-4ded-b2df-d4edfd8a0e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ba8626-1c1b-4414-b6ba-8d822bc9aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:54 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Volume 3893b409-d326-4206-8991-b4844429653d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3893b409-d326-4206-8991-b4844429653d', 'volume_size': 1}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206419373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3893b409-d326-4206-8991-b4844429653d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:55Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Creating volume 3893b409-d326-4206-8991-b4844429653d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:54 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:54 devstack sudo[107294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d 1073741824
Nov 05 04:35:54 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:55 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d 1073741824" returned: 0 in 0.488s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:55 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d
Nov 05 04:35:55 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:55 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:55 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:55 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ba8626-1c1b-4414-b6ba-8d822bc9aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3893b409-d326-4206-8991-b4844429653d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56164d8-99d4-4d22-a800-7b4ec69ea631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:55 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Volume volume-3893b409-d326-4206-8991-b4844429653d (3893b409-d326-4206-8991-b4844429653d): created successfully
Nov 05 04:35:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56164d8-99d4-4d22-a800-7b4ec69ea631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:55 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (d010113f-455e-4f1f-8fb2-42bdbc996f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-048c11de-a1f7-4ebb-8db7-fb2d686aa90a tempest-ProjectMemberTests-1218408516 None] Created volume successfully.
Nov 05 04:35:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Creating offline snapshot 030a5ff6-21b8-49ca-8822-7445ac7f364e of volume 3893b409-d326-4206-8991-b4844429653d {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:35:57 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b948d51-51fa-411c-a7de-128a95b2ce01]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:35:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:57 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d
Nov 05 04:35:57 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:57 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d" returned: 0 in 0.435s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:57 devstack sudo[107308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e 1G
Nov 05 04:35:57 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:57 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:35:57 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Flow 'volume_create_manager' (76a82067-a02f-4655-918a-6281f13da8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db1f248-72de-40e9-bf1a-05b70056d709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db1f248-72de-40e9-bf1a-05b70056d709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177900722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da88675-3ecc-416f-89e3-7c5f5e8214da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cc4db2daeb44a4bfbee375ebebe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:58Z,use_quota=True,user_id='d4b5271265a141b084009384544f37dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442b7d97-53eb-4793-bde0-324023b0759d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (442b7d97-53eb-4793-bde0-324023b0759d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:58 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309dc26f-58dd-4987-9990-8de6e1cf5c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309dc26f-58dd-4987-9990-8de6e1cf5c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da88675-3ecc-416f-89e3-7c5f5e8214da', 'volume_name': 'volume-8da88675-3ecc-416f-89e3-7c5f5e8214da', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10caa95e-6d80-4fce-8750-dac578f0eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10caa95e-6d80-4fce-8750-dac578f0eac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecf784c-22ef-478e-bca6-aa4fc9fe71c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:58 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Volume 8da88675-3ecc-416f-89e3-7c5f5e8214da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da88675-3ecc-416f-89e3-7c5f5e8214da', 'volume_size': 1}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e 1G" returned: 0 in 0.581s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3893b409-d326-4206-8991-b4844429653d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:58 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3893b409-d326-4206-8991-b4844429653d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e
Nov 05 04:35:58 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:58 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3893b409-d326-4206-8991-b4844429653d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e" returned: 0 in 0.297s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:58 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e is being set with open permissions: ugo+rw
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:58 devstack sudo[107319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e
Nov 05 04:35:58 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:58 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:58 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.info
Nov 05 04:35:58 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:58 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.info" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:58 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.info is being set with open permissions: ugo+rw
Nov 05 04:35:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:58 devstack sudo[107325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.info
Nov 05 04:35:58 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:59 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.info" returned: 0 in 0.255s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.190s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1177900722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da88675-3ecc-416f-89e3-7c5f5e8214da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cc4db2daeb44a4bfbee375ebebe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:35:58Z,use_quota=True,user_id='d4b5271265a141b084009384544f37dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Creating volume 8da88675-3ecc-416f-89e3-7c5f5e8214da {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:35:59 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:59 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da 1073741824
Nov 05 04:35:59 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:59 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e0e19b4a-6bc7-42f8-b783-493380cadaa1 tempest-ProjectMemberTests-1218408516 None] Create snapshot completed successfully
Nov 05 04:35:59 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da 1073741824" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:35:59 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da
Nov 05 04:35:59 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:35:59 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da" returned: 0 in 0.252s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ecf784c-22ef-478e-bca6-aa4fc9fe71c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da88675-3ecc-416f-89e3-7c5f5e8214da', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b918491-e1ae-47ea-aaa1-f01650818bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:35:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Volume volume-8da88675-3ecc-416f-89e3-7c5f5e8214da (8da88675-3ecc-416f-89e3-7c5f5e8214da): created successfully
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b918491-e1ae-47ea-aaa1-f01650818bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:35:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Flow 'volume_create_manager' (76a82067-a02f-4655-918a-6281f13da8ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2fbc2ba0-7104-4136-82c4-09269a7cf2f0 tempest-ProjectReaderTests-1516009369 None] Created volume successfully.
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-030a5ff6-21b8-49ca-8822-7445ac7f364e-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-030a5ff6-21b8-49ca-8822-7445ac7f364e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-3893b409-d326-4206-8991-b4844429653d" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-3893b409-d326-4206-8991-b4844429653d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-030a5ff6-21b8-49ca-8822-7445ac7f364e" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-030a5ff6-21b8-49ca-8822-7445ac7f364e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Deleting offline snapshot 030a5ff6-21b8-49ca-8822-7445ac7f364e of volume 3893b409-d326-4206-8991-b4844429653d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] snapshot_file for this snap is: volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbeb405b-4f1f-4e2e-bf06-63af566fe2d3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:00 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e
Nov 05 04:36:00 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:00 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e" returned: 0 in 0.375s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3893b409-d326-4206-8991-b4844429653d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b93890-a228-4e2c-af1b-d445b895686f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:00 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d
Nov 05 04:36:00 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:01 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d" returned: 0 in 0.397s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:01 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e
Nov 05 04:36:01 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Acquiring lock "cinder-8da88675-3ecc-416f-89e3-7c5f5e8214da-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Lock "cinder-8da88675-3ecc-416f-89e3-7c5f5e8214da-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:01 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e" returned: 0 in 0.404s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:01 devstack sudo[107354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Acquiring lock "cinder-quobyte-8da88675-3ecc-416f-89e3-7c5f5e8214da" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:01 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Lock "cinder-quobyte-8da88675-3ecc-416f-89e3-7c5f5e8214da" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51cde87-c6ca-4ca3-953e-e330f494a9da]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:01 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da
Nov 05 04:36:01 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:01 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d.030a5ff6-21b8-49ca-8822-7445ac7f364e" returned: 0 in 0.303s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-030a5ff6-21b8-49ca-8822-7445ac7f364e" released by "_delete_snapshot" :: held 1.624s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-3893b409-d326-4206-8991-b4844429653d" released by "delete_snapshot" :: held 1.651s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Created reservations ['5fcc9139-b1c3-4c94-8bac-4a23efceaf39', 'd9ede954-1a60-4a1f-9b9b-f245e70d53f2', '92062c2f-5dc7-4d52-8450-1386562b8f9b', 'abcf201d-db09-4ac6-8134-b758503cb97f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:01 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Delete snapshot completed successfully.
Nov 05 04:36:01 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da" returned: 0 in 0.410s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-1bad1d5e-62dd-43a2-8636-758144b09646 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-030a5ff6-21b8-49ca-8822-7445ac7f364e-delete_snapshot" released by "delete_snapshot" :: held 1.837s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:02 devstack sudo[107362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da
Nov 05 04:36:02 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:02 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-8da88675-3ecc-416f-89e3-7c5f5e8214da" returned: 0 in 0.262s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Lock "cinder-quobyte-8da88675-3ecc-416f-89e3-7c5f5e8214da" released by "delete_volume" :: held 0.735s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Created reservations ['bbca5d8d-dd85-497b-a1ba-e780d7aa69f8', 'db6ac719-ad20-4d92-93e9-3745cd09add7', 'b5808728-585d-44cc-8ec4-5b99497c4387', 'c0a0dff2-f991-4c98-9311-c78a4c609953'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-3893b409-d326-4206-8991-b4844429653d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Lock "cinder-3893b409-d326-4206-8991-b4844429653d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:02 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:02 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-3893b409-d326-4206-8991-b4844429653d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-3893b409-d326-4206-8991-b4844429653d" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cf2db7-ea20-4037-b771-8d29a595f704]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:02 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d
Nov 05 04:36:02 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:02 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.275s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Deleted volume successfully.
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0aa61269-eeee-4fbf-a935-a3f74ef7e9e2 tempest-ProjectReaderTests-1516009369 None] Lock "cinder-8da88675-3ecc-416f-89e3-7c5f5e8214da-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:02 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:02 devstack sudo[107373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d
Nov 05 04:36:02 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Flow 'volume_create_manager' (800cb706-bf3e-4a32-83ed-044368a004af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d02553-2de6-46ca-9bee-fea8da8f4533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90d02553-2de6-46ca-9bee-fea8da8f4533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807183663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852af105-d38f-4247-937a-4b213624f1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cc4db2daeb44a4bfbee375ebebe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:03Z,use_quota=True,user_id='d4b5271265a141b084009384544f37dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a952af6a-2113-4fa5-879e-efc55dd2c2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a952af6a-2113-4fa5-879e-efc55dd2c2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a40f60-581c-4bab-a09a-00003ffe0d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a40f60-581c-4bab-a09a-00003ffe0d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '852af105-d38f-4247-937a-4b213624f1e5', 'volume_name': 'volume-852af105-d38f-4247-937a-4b213624f1e5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2329e6-473a-4722-b00b-982bd202f206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2329e6-473a-4722-b00b-982bd202f206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f879b6a-0e12-4f73-b7b0-60044993f6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:03 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Volume 852af105-d38f-4247-937a-4b213624f1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-852af105-d38f-4247-937a-4b213624f1e5', 'volume_size': 1}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1807183663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=852af105-d38f-4247-937a-4b213624f1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2cc4db2daeb44a4bfbee375ebebe686',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:03Z,use_quota=True,user_id='d4b5271265a141b084009384544f37dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Creating volume 852af105-d38f-4247-937a-4b213624f1e5 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:03 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:03 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5 1073741824
Nov 05 04:36:03 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:03 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-3893b409-d326-4206-8991-b4844429653d" returned: 0 in 0.265s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-3893b409-d326-4206-8991-b4844429653d" released by "delete_volume" :: held 0.766s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Created reservations ['91eabc0f-5331-4872-be26-b759f2545f07', '52fcf0f6-cb15-4a16-b95a-1fa0d200d745', '0b56e21c-fac5-4042-af43-1fdd15baaea1', '8a800dd2-9202-4ec9-b916-3f204c0ff4fc'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:03 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:03 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:03 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Deleted volume successfully.
Nov 05 04:36:03 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5 1073741824" returned: 0 in 0.467s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-63211b56-c523-4914-bb10-750665bd0b2b tempest-ProjectMemberTests-1218408516 None] Lock "cinder-3893b409-d326-4206-8991-b4844429653d-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:03 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5
Nov 05 04:36:03 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:03 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f879b6a-0e12-4f73-b7b0-60044993f6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-852af105-d38f-4247-937a-4b213624f1e5', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd77d52-9ae4-4f6c-a2f7-ef5828b4b53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Volume volume-852af105-d38f-4247-937a-4b213624f1e5 (852af105-d38f-4247-937a-4b213624f1e5): created successfully
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd77d52-9ae4-4f6c-a2f7-ef5828b4b53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Flow 'volume_create_manager' (800cb706-bf3e-4a32-83ed-044368a004af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-87a62721-4dd3-4302-a477-9e175d4970c3 tempest-ProjectReaderTests-1516009369 None] Created volume successfully.
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (a86c0ec5-920b-4156-bbe2-75ee7972e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cf2078-e1b6-4bb7-ae8a-695eb6274ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49cf2078-e1b6-4bb7-ae8a-695eb6274ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628294482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38196b7-a90c-4f88-9712-8c6309352a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:04Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9b96d6-c58e-4ab4-8141-6dcb22140f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9b96d6-c58e-4ab4-8141-6dcb22140f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8af0799-7d23-4434-9a58-7e2e54b37fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8af0799-7d23-4434-9a58-7e2e54b37fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd38196b7-a90c-4f88-9712-8c6309352a95', 'volume_name': 'volume-d38196b7-a90c-4f88-9712-8c6309352a95', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fb0c95-e89f-414b-9107-b82ff4175c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4fb0c95-e89f-414b-9107-b82ff4175c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f029ea2-a541-4e0f-b31a-029bbdc1d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Volume d38196b7-a90c-4f88-9712-8c6309352a95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d38196b7-a90c-4f88-9712-8c6309352a95', 'volume_size': 1}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-628294482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d38196b7-a90c-4f88-9712-8c6309352a95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:04Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Creating volume d38196b7-a90c-4f88-9712-8c6309352a95 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:04 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:04 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95 1073741824
Nov 05 04:36:04 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:04 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95 1073741824" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:04 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95
Nov 05 04:36:04 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:04 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95" returned: 0 in 0.243s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f029ea2-a541-4e0f-b31a-029bbdc1d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d38196b7-a90c-4f88-9712-8c6309352a95', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3ee3c1-5eeb-42c4-ba37-97cf2a5302d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:04 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Volume volume-d38196b7-a90c-4f88-9712-8c6309352a95 (d38196b7-a90c-4f88-9712-8c6309352a95): created successfully
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e3ee3c1-5eeb-42c4-ba37-97cf2a5302d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:04 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (a86c0ec5-920b-4156-bbe2-75ee7972e55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-969d2681-4970-4482-b30f-6f60dfd3cf74 tempest-ProjectMemberTests-1218408516 None] Created volume successfully.
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Acquiring lock "cinder-852af105-d38f-4247-937a-4b213624f1e5-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Lock "cinder-852af105-d38f-4247-937a-4b213624f1e5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Creating offline snapshot bd6f8a5d-2a83-471d-bf26-3d7d789c210a of volume d38196b7-a90c-4f88-9712-8c6309352a95 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4255d3-d708-4b29-8b21-77663c5cdd0a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Acquiring lock "cinder-quobyte-852af105-d38f-4247-937a-4b213624f1e5" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Lock "cinder-quobyte-852af105-d38f-4247-937a-4b213624f1e5" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba29e9-965f-470b-b7c4-3b88e6c4cffc]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:05 devstack sudo[107397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95
Nov 05 04:36:05 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:05 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5
Nov 05 04:36:05 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:05 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:05 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a 1G
Nov 05 04:36:05 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:05 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5" returned: 0 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:05 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5
Nov 05 04:36:05 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:06 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-852af105-d38f-4247-937a-4b213624f1e5" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Lock "cinder-quobyte-852af105-d38f-4247-937a-4b213624f1e5" released by "delete_volume" :: held 0.690s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Created reservations ['68c6e918-c6f2-49ae-adb2-ba4e21d0e807', '375b4543-4ac5-4f65-b2d8-debe10d84403', 'd53ad7c4-ed0f-40a0-b584-097a51f2dd85', '083462b2-373c-40dd-826d-d281c167c9f5'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:06 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a 1G" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d38196b7-a90c-4f88-9712-8c6309352a95 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:06 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d38196b7-a90c-4f88-9712-8c6309352a95 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a
Nov 05 04:36:06 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:06 devstack sudo[107418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:06 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:06 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d38196b7-a90c-4f88-9712-8c6309352a95 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a" returned: 0 in 0.324s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:06 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a is being set with open permissions: ugo+rw
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:06 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:06 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a
Nov 05 04:36:06 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Deleted volume successfully.
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-db6391fb-2fdb-406a-8b83-409ea22a013b tempest-ProjectReaderTests-1516009369 None] Lock "cinder-852af105-d38f-4247-937a-4b213624f1e5-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:06 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a" returned: 0 in 0.263s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:06 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.info
Nov 05 04:36:06 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:06 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.info" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:06 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.info is being set with open permissions: ugo+rw
Nov 05 04:36:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:07 devstack sudo[107430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.info
Nov 05 04:36:07 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:07 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.info" returned: 0 in 0.245s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:07 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:07 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-97d288df-7c36-449a-968c-d770789487e5 tempest-ProjectMemberTests-1218408516 None] Create snapshot completed successfully
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-bd6f8a5d-2a83-471d-bf26-3d7d789c210a-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-bd6f8a5d-2a83-471d-bf26-3d7d789c210a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-d38196b7-a90c-4f88-9712-8c6309352a95" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-d38196b7-a90c-4f88-9712-8c6309352a95" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-bd6f8a5d-2a83-471d-bf26-3d7d789c210a" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-bd6f8a5d-2a83-471d-bf26-3d7d789c210a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Deleting offline snapshot bd6f8a5d-2a83-471d-bf26-3d7d789c210a of volume d38196b7-a90c-4f88-9712-8c6309352a95 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] snapshot_file for this snap is: volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8958644f-298a-4b5e-a457-97db6b3bd002]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:08 devstack sudo[107433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a
Nov 05 04:36:08 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:08 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a" returned: 0 in 0.403s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d38196b7-a90c-4f88-9712-8c6309352a95(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d6b0f6-e2f8-4c4a-bf46-8a42f96b01ca]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:08 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:09 devstack sudo[107438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95
Nov 05 04:36:09 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:09 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95" returned: 0 in 0.367s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:09 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a
Nov 05 04:36:09 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:09 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a" returned: 0 in 0.345s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:09 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a
Nov 05 04:36:09 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:09 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:09 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95.bd6f8a5d-2a83-471d-bf26-3d7d789c210a" returned: 0 in 0.267s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-bd6f8a5d-2a83-471d-bf26-3d7d789c210a" released by "_delete_snapshot" :: held 1.497s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:09 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-d38196b7-a90c-4f88-9712-8c6309352a95" released by "delete_snapshot" :: held 1.519s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Flow 'volume_create_manager' (31cfa1cd-4e9a-4dce-b5d2-049ed5139c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467db5fa-df5c-4a29-9ec9-b94fc4cdfc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467db5fa-df5c-4a29-9ec9-b94fc4cdfc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1215342187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b61f736-25c8-444c-8351-90f76be2da40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4972d566e7f540999c258c0747c6bd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:10Z,use_quota=True,user_id='355c28e28b7445619ecd27af2f96eaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9f865e-915d-44f0-ae85-1ecbc0fd998f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9f865e-915d-44f0-ae85-1ecbc0fd998f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e23cbe-209c-48cf-93d3-2b44d1c5d50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e23cbe-209c-48cf-93d3-2b44d1c5d50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b61f736-25c8-444c-8351-90f76be2da40', 'volume_name': 'volume-4b61f736-25c8-444c-8351-90f76be2da40', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1d44b0-a677-4970-96ed-7d814636b795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc1d44b0-a677-4970-96ed-7d814636b795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e881d0-1e01-4a74-b307-64bb52a29e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Volume 4b61f736-25c8-444c-8351-90f76be2da40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b61f736-25c8-444c-8351-90f76be2da40', 'volume_size': 1}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1215342187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b61f736-25c8-444c-8351-90f76be2da40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4972d566e7f540999c258c0747c6bd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:10Z,use_quota=True,user_id='355c28e28b7445619ecd27af2f96eaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Creating volume 4b61f736-25c8-444c-8351-90f76be2da40 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:10 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:10 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40 1073741824
Nov 05 04:36:10 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Created reservations ['411af539-b3b8-458f-83ad-c08f2a8a3296', '99239c9c-c492-4fa3-9af0-cc9de1bc44b5', 'af13fcea-43f2-4dc6-9f50-1e94a9014840', '19e79d94-ea8f-46d7-b96c-d500e5de3c0f'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Delete snapshot completed successfully.
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-0a50124d-cc6a-44e9-9808-375751ebc4c3 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-bd6f8a5d-2a83-471d-bf26-3d7d789c210a-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:10 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40 1073741824" returned: 0 in 0.415s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-d38196b7-a90c-4f88-9712-8c6309352a95-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:10 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40
Nov 05 04:36:10 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-d38196b7-a90c-4f88-9712-8c6309352a95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-d38196b7-a90c-4f88-9712-8c6309352a95" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-d38196b7-a90c-4f88-9712-8c6309352a95" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e30d3f-28d4-4aca-b777-ec86ee2d6a84]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:10 devstack sudo[107459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95
Nov 05 04:36:10 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:10 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40" returned: 0 in 0.288s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e881d0-1e01-4a74-b307-64bb52a29e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b61f736-25c8-444c-8351-90f76be2da40', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13444759-0607-4276-bfa4-1120a8e0b5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:10 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Volume volume-4b61f736-25c8-444c-8351-90f76be2da40 (4b61f736-25c8-444c-8351-90f76be2da40): created successfully
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13444759-0607-4276-bfa4-1120a8e0b5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:10 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Flow 'volume_create_manager' (31cfa1cd-4e9a-4dce-b5d2-049ed5139c9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:10 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bbed4e68-207a-4de7-8486-78f024fe8a36 tempest-ProjectReaderTests-1317557310 None] Created volume successfully.
Nov 05 04:36:11 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95" returned: 0 in 0.379s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:11 devstack sudo[107465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95
Nov 05 04:36:11 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Acquiring lock "cinder-4b61f736-25c8-444c-8351-90f76be2da40-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Lock "cinder-4b61f736-25c8-444c-8351-90f76be2da40-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Acquiring lock "cinder-quobyte-4b61f736-25c8-444c-8351-90f76be2da40" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Lock "cinder-quobyte-4b61f736-25c8-444c-8351-90f76be2da40" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[92685519-1da8-47bc-9e90-ad3843936d3c]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:11 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-d38196b7-a90c-4f88-9712-8c6309352a95" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-d38196b7-a90c-4f88-9712-8c6309352a95" released by "delete_volume" :: held 0.712s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:11 devstack sudo[107467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40
Nov 05 04:36:11 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Created reservations ['cc89d493-626e-400c-ad67-b6c58eecafa1', '9d2e9502-d129-430d-87db-7b0ec73bc490', '0ec9cf0d-768e-47be-a3ee-6630418aacc2', 'a0ec55f9-1043-45c9-9b97-389b78cd7841'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:11 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:11 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:11 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:11 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40
Nov 05 04:36:11 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:11 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.274s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:11 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Deleted volume successfully.
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-fd438450-e642-4da8-803f-8d74c8688534 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-d38196b7-a90c-4f88-9712-8c6309352a95-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:11 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-4b61f736-25c8-444c-8351-90f76be2da40" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Lock "cinder-quobyte-4b61f736-25c8-444c-8351-90f76be2da40" released by "delete_volume" :: held 0.694s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:11 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Created reservations ['5813e7e3-6f33-4361-a302-bd932e6bf6e7', '751b87ad-ab02-4fab-b46d-980f996119fc', '26aa6c81-a39f-41c3-8e89-cc2a86aeee52', 'fa69a7af-7d20-46e7-978d-d180a102882a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:12 devstack sudo[107480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:12 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (2abbe168-7b31-42ca-94cc-a0ef3adf43a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20cb255-c025-4d69-b69d-79e610bc970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20cb255-c025-4d69-b69d-79e610bc970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174973667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:12Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2b922d-32f9-49f5-af8e-7133d9b5afe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e2b922d-32f9-49f5-af8e-7133d9b5afe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed090f4-7e97-405f-aee0-0ffda731afd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed090f4-7e97-405f-aee0-0ffda731afd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a', 'volume_name': 'volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6258cb20-63b0-4ab6-a303-eda90387bb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6258cb20-63b0-4ab6-a303-eda90387bb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8efb3df-407c-4828-80cf-c730648d616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Volume 6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a', 'volume_size': 1}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1174973667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:12Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Creating volume 6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:12 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:12 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:12 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Deleted volume successfully.
Nov 05 04:36:12 devstack sudo[107483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a 1073741824
Nov 05 04:36:12 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-560b1832-4606-41a6-a2c1-334dbe02ad4e tempest-ProjectReaderTests-1317557310 None] Lock "cinder-4b61f736-25c8-444c-8351-90f76be2da40-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Flow 'volume_create_manager' (47e75575-ab8d-4538-8c42-178bf095eb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a28848e-b2f2-41c1-9e9c-374fb854f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a 1073741824" returned: 0 in 0.495s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a28848e-b2f2-41c1-9e9c-374fb854f13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695029773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b4cd6a-6c96-4600-b9b0-1a2286b47380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4972d566e7f540999c258c0747c6bd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:13Z,use_quota=True,user_id='355c28e28b7445619ecd27af2f96eaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3508c9bd-e25d-4113-b957-eade84fbce7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3508c9bd-e25d-4113-b957-eade84fbce7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5c7bda-1268-4d14-afdd-ae84ccb56988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5c7bda-1268-4d14-afdd-ae84ccb56988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b4cd6a-6c96-4600-b9b0-1a2286b47380', 'volume_name': 'volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7cb123-5b38-4b1c-b2f7-f4fde937cc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7cb123-5b38-4b1c-b2f7-f4fde937cc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e39997-c876-4e09-9f2c-be5b3f3472fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:12 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Volume 06b4cd6a-6c96-4600-b9b0-1a2286b47380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380', 'volume_size': 1}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:12 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:12 devstack sudo[107488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a
Nov 05 04:36:12 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:13 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.274s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695029773',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b4cd6a-6c96-4600-b9b0-1a2286b47380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4972d566e7f540999c258c0747c6bd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:13Z,use_quota=True,user_id='355c28e28b7445619ecd27af2f96eaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Creating volume 06b4cd6a-6c96-4600-b9b0-1a2286b47380 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:13 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8efb3df-407c-4828-80cf-c730648d616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f5e5f1-49fe-493e-b3c2-c01a4180eb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:13 devstack sudo[107491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380 1073741824
Nov 05 04:36:13 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Volume volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a (6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a): created successfully
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f5e5f1-49fe-493e-b3c2-c01a4180eb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (2abbe168-7b31-42ca-94cc-a0ef3adf43a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-860316c8-c2fa-4429-ba51-d0f0a9a87f31 tempest-ProjectMemberTests-1218408516 None] Created volume successfully.
Nov 05 04:36:13 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380 1073741824" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:13 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380
Nov 05 04:36:13 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:13 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e39997-c876-4e09-9f2c-be5b3f3472fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130c4d25-35d8-46e1-95ac-6eeb2024efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:13 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Volume volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380 (06b4cd6a-6c96-4600-b9b0-1a2286b47380): created successfully
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130c4d25-35d8-46e1-95ac-6eeb2024efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:13 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Flow 'volume_create_manager' (47e75575-ab8d-4538-8c42-178bf095eb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:13 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7b221fbb-d10f-4f17-af79-0bba66c9c237 tempest-ProjectReaderTests-1317557310 None] Created volume successfully.
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Creating offline snapshot 18772236-f0d4-43bc-b105-720e1399fc05 of volume 6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f2707-134f-40f2-a4e2-e67d1702990b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:14 devstack sudo[107501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a
Nov 05 04:36:14 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:14 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" returned: 0 in 0.358s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:14 devstack sudo[107506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 1G
Nov 05 04:36:14 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Acquiring lock "cinder-06b4cd6a-6c96-4600-b9b0-1a2286b47380-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Lock "cinder-06b4cd6a-6c96-4600-b9b0-1a2286b47380-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:14 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Acquiring lock "cinder-quobyte-06b4cd6a-6c96-4600-b9b0-1a2286b47380" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Lock "cinder-quobyte-06b4cd6a-6c96-4600-b9b0-1a2286b47380" acquired by "delete_volume" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[561923ff-a537-43f8-9367-dd8a45157016]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:15 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380
Nov 05 04:36:15 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:15 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 1G" returned: 0 in 0.416s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:15 devstack sudo[107513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05
Nov 05 04:36:15 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:15 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380" returned: 0 in 0.399s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:15 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380
Nov 05 04:36:15 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:15 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05" returned: 0 in 0.323s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:15 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 is being set with open permissions: ugo+rw
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:15 devstack sudo[107523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05
Nov 05 04:36:15 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:15 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-06b4cd6a-6c96-4600-b9b0-1a2286b47380" returned: 0 in 0.273s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Lock "cinder-quobyte-06b4cd6a-6c96-4600-b9b0-1a2286b47380" released by "delete_volume" :: held 0.718s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Created reservations ['f762e789-c6df-498c-838f-5f84911e4233', '07e1bd43-ad1c-4907-bbf4-410bd0e0c4a9', 'e17ec8fd-cf80-457a-9af8-9d7beacb2ac1', '3f02f071-e7d4-4603-91ec-8ba26c2f479c'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:15 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05" returned: 0 in 0.272s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:15 devstack sudo[107527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:15 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:15 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:15 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.info
Nov 05 04:36:15 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:16 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.257s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Deleted volume successfully.
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-2ed3fd9b-3e0a-4b02-9de5-69473c6fb89b tempest-ProjectReaderTests-1317557310 None] Lock "cinder-06b4cd6a-6c96-4600-b9b0-1a2286b47380-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:16 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.info" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:16 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.info is being set with open permissions: ugo+rw
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:16 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.info
Nov 05 04:36:16 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:16 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.info" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:16 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c4f4a98a-5ef2-4044-88c5-cbccd874e3a0 tempest-ProjectMemberTests-1218408516 None] Create snapshot completed successfully
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Flow 'volume_create_manager' (751300e2-9e1a-4e9b-943b-1fa9c53b5822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee73846f-ac5c-481a-adbc-c204f1199047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-18772236-f0d4-43bc-b105-720e1399fc05-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee73846f-ac5c-481a-adbc-c204f1199047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24948699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9374faed-7db5-4b8d-85a7-0297f0646d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4972d566e7f540999c258c0747c6bd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:17Z,use_quota=True,user_id='355c28e28b7445619ecd27af2f96eaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36107db-b3bf-4b20-85a2-0d4341b85e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d36107db-b3bf-4b20-85a2-0d4341b85e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ef36e7-904f-44b8-b3e2-31e46d9f5f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1ef36e7-904f-44b8-b3e2-31e46d9f5f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9374faed-7db5-4b8d-85a7-0297f0646d59', 'volume_name': 'volume-9374faed-7db5-4b8d-85a7-0297f0646d59', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ed2b11-cc78-4b0d-8542-27b40cb963bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ed2b11-cc78-4b0d-8542-27b40cb963bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714bc51e-d3db-4eb0-91d7-b3b17ac97862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:16 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Volume 9374faed-7db5-4b8d-85a7-0297f0646d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9374faed-7db5-4b8d-85a7-0297f0646d59', 'volume_size': 1}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-24948699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9374faed-7db5-4b8d-85a7-0297f0646d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4972d566e7f540999c258c0747c6bd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:17Z,use_quota=True,user_id='355c28e28b7445619ecd27af2f96eaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Creating volume 9374faed-7db5-4b8d-85a7-0297f0646d59 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:16 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-18772236-f0d4-43bc-b105-720e1399fc05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:16 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59 1073741824
Nov 05 04:36:16 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-18772236-f0d4-43bc-b105-720e1399fc05" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-18772236-f0d4-43bc-b105-720e1399fc05" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Deleting offline snapshot 18772236-f0d4-43bc-b105-720e1399fc05 of volume 6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] snapshot_file for this snap is: volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0c583d-c4d7-4383-98af-3fa17e19dca0]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:16 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:16 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05
Nov 05 04:36:16 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:17 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59 1073741824" returned: 0 in 0.427s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:17 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59
Nov 05 04:36:17 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:17 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05" returned: 0 in 0.403s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[f193b362-2f2d-490d-aa1f-e85be6330dc1]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:17 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a
Nov 05 04:36:17 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:17 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714bc51e-d3db-4eb0-91d7-b3b17ac97862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9374faed-7db5-4b8d-85a7-0297f0646d59', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7e24e4-9ae0-4a3a-897b-4cc655811c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:17 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Volume volume-9374faed-7db5-4b8d-85a7-0297f0646d59 (9374faed-7db5-4b8d-85a7-0297f0646d59): created successfully
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b7e24e4-9ae0-4a3a-897b-4cc655811c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Flow 'volume_create_manager' (751300e2-9e1a-4e9b-943b-1fa9c53b5822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:17 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a82f8138-c28e-4897-a56d-f9773b480803 tempest-ProjectReaderTests-1317557310 None] Created volume successfully.
Nov 05 04:36:17 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:17 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05
Nov 05 04:36:17 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Acquiring lock "cinder-9374faed-7db5-4b8d-85a7-0297f0646d59-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Lock "cinder-9374faed-7db5-4b8d-85a7-0297f0646d59-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Acquiring lock "cinder-quobyte-9374faed-7db5-4b8d-85a7-0297f0646d59" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Lock "cinder-quobyte-9374faed-7db5-4b8d-85a7-0297f0646d59" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3dbef3-9017-493a-8235-a5516b61427d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:17 devstack sudo[107556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59
Nov 05 04:36:17 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:17 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:17 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:17 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05
Nov 05 04:36:17 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:18 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59" returned: 0 in 0.383s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:18 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59
Nov 05 04:36:18 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:18 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a.18772236-f0d4-43bc-b105-720e1399fc05" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-18772236-f0d4-43bc-b105-720e1399fc05" released by "_delete_snapshot" :: held 1.529s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" released by "delete_snapshot" :: held 1.550s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Created reservations ['c549801d-21dd-4d22-ab5e-fb36b6fc75f4', '4564bfa6-44cf-4bcf-b01d-b9ee77be7292', 'b7777c14-ea32-4bc0-be19-284c244a4540', 'e48eaa6a-cadd-4848-a7ca-fd7078c7912d'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Delete snapshot completed successfully.
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-361ff0e7-456c-4713-8667-2ad71e863600 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-18772236-f0d4-43bc-b105-720e1399fc05-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:18 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9374faed-7db5-4b8d-85a7-0297f0646d59" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Lock "cinder-quobyte-9374faed-7db5-4b8d-85a7-0297f0646d59" released by "delete_volume" :: held 0.697s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Created reservations ['c3f4614e-a68b-4d3b-9018-948aa4dca985', '6c0b1bf7-7449-4597-a328-a8d205738f7d', '9dcdceec-6fd9-45a6-a51b-dca5a0854a50', 'e10872ab-1994-4d76-9692-96e334745b5b'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:18 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:18 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:18 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:18 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Deleted volume successfully.
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-a2623f43-023d-48e2-a8af-0dbd13067779 tempest-ProjectReaderTests-1317557310 None] Lock "cinder-9374faed-7db5-4b8d-85a7-0297f0646d59-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" acquired by "delete_volume" :: waited 0.017s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff651b3-a519-4a40-9a79-4ec67fa666b1]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:18 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:19 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a
Nov 05 04:36:19 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Flow 'volume_create_manager' (f84c3683-4fb2-466d-8320-8d7c6a38f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:19 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b57f87-9ceb-43d2-b37c-062e3dc4711c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" returned: 0 in 0.402s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b57f87-9ceb-43d2-b37c-062e3dc4711c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-429654826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4972d566e7f540999c258c0747c6bd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:19Z,use_quota=True,user_id='355c28e28b7445619ecd27af2f96eaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:19 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a
Nov 05 04:36:19 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d40eec-d975-4522-8675-d4221030d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d40eec-d975-4522-8675-d4221030d10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2382c447-2d08-47ef-b43d-b3e66aa141a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2382c447-2d08-47ef-b43d-b3e66aa141a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476', 'volume_name': 'volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e253b55e-5e73-4254-8477-f02ffe9b48c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e253b55e-5e73-4254-8477-f02ffe9b48c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45be139-ea64-44f1-a348-e9f968620048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:19 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Volume 0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476', 'volume_size': 1}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-429654826',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4972d566e7f540999c258c0747c6bd8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:19Z,use_quota=True,user_id='355c28e28b7445619ecd27af2f96eaf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Creating volume 0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:19 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:19 devstack sudo[107587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476 1073741824
Nov 05 04:36:19 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:19 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a" released by "delete_volume" :: held 0.722s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Created reservations ['c5d4960f-e7da-46d1-8049-24cb4748af90', 'b1777258-80c4-44a5-8976-9d6a1b20fe99', '2013d1f8-81c1-4b2f-87f1-ab9f14766360', '674f9184-9785-4ca7-91d1-a8bbd49ff2af'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:19 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:19 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:19 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476 1073741824" returned: 0 in 0.439s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:19 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:19 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476
Nov 05 04:36:19 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:20 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.260s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Deleted volume successfully.
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-4663fa5d-30dd-4a62-8c20-fb191dc62630 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-6f3f6de0-8db4-4f0b-8a5a-0e6364eef84a-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:20 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45be139-ea64-44f1-a348-e9f968620048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c67948-8510-4bc3-b38b-e67f96380da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:20 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Volume volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476 (0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476): created successfully
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c67948-8510-4bc3-b38b-e67f96380da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Flow 'volume_create_manager' (f84c3683-4fb2-466d-8320-8d7c6a38f537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:20 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-bfdcf286-dcc0-438b-aa52-2e4f2b3e1c7c tempest-ProjectReaderTests-1317557310 None] Created volume successfully.
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Acquiring lock "cinder-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Lock "cinder-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Acquiring lock "cinder-quobyte-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Lock "cinder-quobyte-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76d732c-ac01-45c4-9c28-d7e82c74ef9d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (b43e639f-e080-4e48-91da-51093300cfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c57b187-1168-4566-9915-e8103e92f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c57b187-1168-4566-9915-e8103e92f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483313792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:20Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263a9399-0df4-499c-8ad2-e08411908d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (263a9399-0df4-499c-8ad2-e08411908d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5223a6ca-2147-4bf8-9437-096af6f6232e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5223a6ca-2147-4bf8-9437-096af6f6232e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329', 'volume_name': 'volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6387208b-56c3-4fab-ada2-cf2d668f4e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6387208b-56c3-4fab-ada2-cf2d668f4e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8551539c-103a-49c3-8f78-a30aaee69df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:20 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Volume f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329', 'volume_size': 1}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483313792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:20Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Creating volume f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:20 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:20 devstack sudo[107601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476
Nov 05 04:36:20 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:20 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 1073741824
Nov 05 04:36:20 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:20 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476" returned: 0 in 0.371s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:20 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:20 devstack sudo[107611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476
Nov 05 04:36:20 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:21 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 1073741824" returned: 0 in 0.449s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:21 devstack sudo[107614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329
Nov 05 04:36:21 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:21 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476" returned: 0 in 0.262s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Lock "cinder-quobyte-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476" released by "delete_volume" :: held 0.675s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Created reservations ['f87284b6-37d2-4099-b1c9-9da7353a2caf', 'efa973a1-e9a9-4e62-a80e-a5b12fa66e68', '4c6538a9-0424-4475-acc7-c82e1082ff53', '878cc05f-c05c-4a41-bdd9-93f43fc1852a'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:21 devstack sudo[107616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:21 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:21 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" returned: 0 in 0.249s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8551539c-103a-49c3-8f78-a30aaee69df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b82a1d-75ff-454c-890a-cfc6746ec3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:21 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Volume volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 (f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329): created successfully
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b82a1d-75ff-454c-890a-cfc6746ec3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (b43e639f-e080-4e48-91da-51093300cfce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-374f05e9-d170-4960-8e50-a6e5eb5c6a70 tempest-ProjectMemberTests-1218408516 None] Created volume successfully.
Nov 05 04:36:21 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:21 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Deleted volume successfully.
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-aa09e3d5-d654-4f2b-8064-6f830c4b993e tempest-ProjectReaderTests-1317557310 None] Lock "cinder-0a76b25c-3d81-41a3-aa8c-8a3c3e6a3476-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Creating offline snapshot e6210ce4-3f5b-4783-b4ac-18e55878a522 of volume f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[596e3ade-ac0e-43c2-a170-2d75204c2490]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:21 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:21 devstack sudo[107620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329
Nov 05 04:36:21 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:22 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" returned: 0 in 0.391s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:22 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 1G
Nov 05 04:36:22 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:22 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 1G" returned: 0 in 0.434s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:22 devstack sudo[107631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522
Nov 05 04:36:22 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:22 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522" returned: 0 in 0.334s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:22 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 is being set with open permissions: ugo+rw
Nov 05 04:36:22 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:22 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522
Nov 05 04:36:22 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:23 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522" returned: 0 in 0.284s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:23 devstack sudo[107640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.info
Nov 05 04:36:23 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:23 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.info" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:23 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.info is being set with open permissions: ugo+rw
Nov 05 04:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:23 devstack sudo[107643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.info
Nov 05 04:36:23 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:23 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.info" returned: 0 in 0.256s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:23 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:23 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2ff16018-2b48-4fae-b29e-cc98e9a94bd2 tempest-ProjectMemberTests-1218408516 None] Create snapshot completed successfully
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-e6210ce4-3f5b-4783-b4ac-18e55878a522-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-e6210ce4-3f5b-4783-b4ac-18e55878a522-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-e6210ce4-3f5b-4783-b4ac-18e55878a522" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-e6210ce4-3f5b-4783-b4ac-18e55878a522" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Deleting offline snapshot e6210ce4-3f5b-4783-b4ac-18e55878a522 of volume f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] snapshot_file for this snap is: volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7b6c91-039d-4838-8de1-b646f5b9f1ac]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:24 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:25 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522
Nov 05 04:36:25 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:25 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522" returned: 0 in 0.389s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:25 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:36:25 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f087d0-c857-4320-a510-567711aafd89]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:25 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329
Nov 05 04:36:25 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:25 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" returned: 0 in 0.367s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:25 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:25 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522
Nov 05 04:36:25 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:26 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522" returned: 0 in 0.332s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:26 devstack sudo[107662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522
Nov 05 04:36:26 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:26 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:26 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329.e6210ce4-3f5b-4783-b4ac-18e55878a522" returned: 0 in 0.269s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-e6210ce4-3f5b-4783-b4ac-18e55878a522" released by "_delete_snapshot" :: held 1.462s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" released by "delete_snapshot" :: held 1.487s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:26 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Created reservations ['5d8531dd-4a5a-4c1a-a331-f9c232802247', 'ee34ceb5-5604-4a5b-bc60-5c8901b30fe7', '742af656-d0b4-4f02-8171-3a36bde77118', '81f8c49f-a621-41f4-89af-4362682dd6da'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:26 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Delete snapshot completed successfully.
Nov 05 04:36:26 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-7e2a8a27-bfa6-49f6-89dd-78855ea58047 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-e6210ce4-3f5b-4783-b4ac-18e55878a522-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" acquired by "delete_volume" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e47103-508a-45c3-af59-eb01dc3ae7cd]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:27 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329
Nov 05 04:36:27 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:27 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:27 devstack sudo[107670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329
Nov 05 04:36:27 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:27 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329" released by "delete_volume" :: held 0.736s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Created reservations ['a34b1605-d59e-4af9-9f8f-dd8c19b2c3f4', 'fdfe8498-c299-43d3-8bb7-a601d5603b0b', '17b88059-2732-4fe0-aba1-e6970fcfdab1', 'e2ffcb69-c341-4bea-b467-405aed29e0b1'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:27 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:27 devstack sudo[107673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:27 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:28 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:28 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Deleted volume successfully.
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3addf69e-440e-41c5-8242-face390261c9 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-f33bcba4-47f1-4a60-8ab1-0c3c6ac8d329-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (7cae57dc-c9fa-4074-94ce-214d2f99329f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9742cf3-3c35-4595-ba10-d6b2ca21c159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9742cf3-3c35-4595-ba10-d6b2ca21c159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880327830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c6628c-dd5b-436f-bbd2-6900e38f5c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:29Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90aa0f4c-e156-43f1-b9aa-8302a6537924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90aa0f4c-e156-43f1-b9aa-8302a6537924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba9cdd8-e185-4190-8f6a-3f16a6636ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba9cdd8-e185-4190-8f6a-3f16a6636ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c6628c-dd5b-436f-bbd2-6900e38f5c4d', 'volume_name': 'volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a6a43-bf27-4ad6-a355-009a95e21b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120a6a43-bf27-4ad6-a355-009a95e21b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0292cd9-55a3-4642-aa54-d45380b1d6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:28 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Volume a9c6628c-dd5b-436f-bbd2-6900e38f5c4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d', 'volume_size': 1}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1880327830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c6628c-dd5b-436f-bbd2-6900e38f5c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:29Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Creating volume a9c6628c-dd5b-436f-bbd2-6900e38f5c4d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:28 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:28 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:28 devstack sudo[107676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d 1073741824
Nov 05 04:36:28 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:29 devstack sudo[107681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:29 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:29 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d 1073741824" returned: 0 in 0.498s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:29 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d
Nov 05 04:36:29 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:29 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.307s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 05 04:36:29 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0292cd9-55a3-4642-aa54-d45380b1d6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6027ea59-df80-4cde-bfcf-a9dec664fb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:29 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Volume volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d (a9c6628c-dd5b-436f-bbd2-6900e38f5c4d): created successfully
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6027ea59-df80-4cde-bfcf-a9dec664fb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (7cae57dc-c9fa-4074-94ce-214d2f99329f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:29 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ba2479ef-cc15-4896-baa1-903651f6e610 tempest-ProjectMemberTests-1218408516 None] Created volume successfully.
Nov 05 04:36:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:31 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Creating offline snapshot dc3ac471-2bc2-4f6b-a109-bab25ee35bec of volume a9c6628c-dd5b-436f-bbd2-6900e38f5c4d {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:36:31 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedc08ae-ed62-4f63-b0dc-10479a8df6ed]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:31 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d
Nov 05 04:36:31 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:31 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" returned: 0 in 0.378s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:31 devstack sudo[107694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec 1G
Nov 05 04:36:31 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:31 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec 1G" returned: 0 in 0.408s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:31 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:31 devstack sudo[107699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec
Nov 05 04:36:31 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:32 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec" returned: 0 in 0.357s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:32 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec is being set with open permissions: ugo+rw
Nov 05 04:36:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:32 devstack sudo[107705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec
Nov 05 04:36:32 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:32 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec" returned: 0 in 0.299s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:32 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.info
Nov 05 04:36:32 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:32 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.info" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:32 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.info is being set with open permissions: ugo+rw
Nov 05 04:36:32 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:32 devstack sudo[107711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.info
Nov 05 04:36:32 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:33 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.info" returned: 0 in 0.261s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:33 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:33 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e49173c4-e1af-4005-a017-3cf7127b67f7 tempest-ProjectMemberTests-1218408516 None] Create snapshot completed successfully
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-dc3ac471-2bc2-4f6b-a109-bab25ee35bec-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-dc3ac471-2bc2-4f6b-a109-bab25ee35bec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-dc3ac471-2bc2-4f6b-a109-bab25ee35bec" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-dc3ac471-2bc2-4f6b-a109-bab25ee35bec" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Deleting offline snapshot dc3ac471-2bc2-4f6b-a109-bab25ee35bec of volume a9c6628c-dd5b-436f-bbd2-6900e38f5c4d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] snapshot_file for this snap is: volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[4145b926-4a59-49d5-bbf0-bf287fbed087]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:34 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec
Nov 05 04:36:34 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:34 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e435112-de47-472f-b8f0-ca342b9e2875]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:34 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:34 devstack sudo[107720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d
Nov 05 04:36:34 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:35 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" returned: 0 in 0.376s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:35 devstack sudo[107725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec
Nov 05 04:36:35 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:35 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec" returned: 0 in 0.374s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:35 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec
Nov 05 04:36:35 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:35 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:35 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d.dc3ac471-2bc2-4f6b-a109-bab25ee35bec" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-dc3ac471-2bc2-4f6b-a109-bab25ee35bec" released by "_delete_snapshot" :: held 1.507s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" released by "delete_snapshot" :: held 1.530s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:35 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Created reservations ['d1d8c87a-b583-47f5-a82c-4ada4e3bdda9', '610f6275-6f4b-4003-8aee-897e225cc2c1', 'df0da459-838c-4498-a669-88413520c2ab', '87dff0b3-176e-47a5-a6a3-5af36cf3d807'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:35 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Delete snapshot completed successfully.
Nov 05 04:36:35 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-3900790c-0e01-4357-9508-564f41a86f21 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-dc3ac471-2bc2-4f6b-a109-bab25ee35bec-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:36 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:DELETE=23,cinder:UPDATE=218,cinder:SELECT=169,cinder:INSERT=54 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:36:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:36 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:36 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[29464311-f6f4-41fa-87dc-262ec07fde86]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:36 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:36 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d
Nov 05 04:36:36 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:37 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" returned: 0 in 0.380s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:37 devstack sudo[107775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d
Nov 05 04:36:37 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:37 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" returned: 0 in 0.281s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d" released by "delete_volume" :: held 0.738s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=162,cinder:INSERT=67,cinder:UPDATE=214,cinder:DELETE=13 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Created reservations ['9af038f5-838e-4f69-95b4-31bad2dca413', '147821c7-22b0-4d2c-902e-06bfc693ae0a', 'fb369830-3bd6-4a44-9864-4c13d4747af9', 'bd573a2d-5ac0-4ca1-9e3c-d2f3b8d99e33'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:37 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:37 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:37 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.283s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:37 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Deleted volume successfully.
Nov 05 04:36:37 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-105f4eea-10c2-4660-8039-350b8f8f4f63 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-a9c6628c-dd5b-436f-bbd2-6900e38f5c4d-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (49015c06-35d0-4ae9-ae91-60b14926e8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e375cc-9499-49e2-8108-15083f3b3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e375cc-9499-49e2-8108-15083f3b3e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197964ac-381e-41ae-a4c6-339c69f9db37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:38Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057b4403-3ea8-428f-92f8-b904ac0457ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057b4403-3ea8-428f-92f8-b904ac0457ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b377474d-4d13-4dc9-92ca-a7e1a9a2daad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b377474d-4d13-4dc9-92ca-a7e1a9a2daad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '197964ac-381e-41ae-a4c6-339c69f9db37', 'volume_name': 'volume-197964ac-381e-41ae-a4c6-339c69f9db37', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e558cd-af93-40fd-bddf-86847b350b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e558cd-af93-40fd-bddf-86847b350b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9a71d7-aea4-42d7-97e6-6b18da94e6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:38 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Volume 197964ac-381e-41ae-a4c6-339c69f9db37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-197964ac-381e-41ae-a4c6-339c69f9db37', 'volume_size': 1}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-266710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=197964ac-381e-41ae-a4c6-339c69f9db37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:38Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Creating volume 197964ac-381e-41ae-a4c6-339c69f9db37 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:38 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:38 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37 1073741824
Nov 05 04:36:38 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:38 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37 1073741824" returned: 0 in 0.444s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:38 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:38 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37
Nov 05 04:36:38 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:39 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37" returned: 0 in 0.310s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:39 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:39 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b9a71d7-aea4-42d7-97e6-6b18da94e6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-197964ac-381e-41ae-a4c6-339c69f9db37', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b1fe1c-fed2-4829-a8d6-2e56ddd58215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:39 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Volume volume-197964ac-381e-41ae-a4c6-339c69f9db37 (197964ac-381e-41ae-a4c6-339c69f9db37): created successfully
Nov 05 04:36:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b1fe1c-fed2-4829-a8d6-2e56ddd58215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:39 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (49015c06-35d0-4ae9-ae91-60b14926e8a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:39 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2db3eb40-4514-4dbf-9ca0-11b0c5a978b5 tempest-ProjectMemberTests-1218408516 None] Created volume successfully.
Nov 05 04:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:40 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Creating offline snapshot 6ac9a63a-7e0b-489e-9258-af846d1e5383 of volume 197964ac-381e-41ae-a4c6-339c69f9db37 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:36:40 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2633a5-9bfc-438c-87bc-8d968b4ff6c3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:40 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37
Nov 05 04:36:40 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:40 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:40 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:40 devstack sudo[107797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 1G
Nov 05 04:36:40 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:41 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 1G" returned: 0 in 0.466s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197964ac-381e-41ae-a4c6-339c69f9db37 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:41 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197964ac-381e-41ae-a4c6-339c69f9db37 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383
Nov 05 04:36:41 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:41 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-197964ac-381e-41ae-a4c6-339c69f9db37 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383" returned: 0 in 0.327s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:41 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 is being set with open permissions: ugo+rw
Nov 05 04:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:41 devstack sudo[107808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383
Nov 05 04:36:41 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:41 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:41 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383" returned: 0 in 0.252s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:42 devstack sudo[107811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.info
Nov 05 04:36:42 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:42 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.info" returned: 0 in 0.264s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:42 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.info is being set with open permissions: ugo+rw
Nov 05 04:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:42 devstack sudo[107814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.info
Nov 05 04:36:42 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:42 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.info" returned: 0 in 0.266s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:42 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:42 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-1f745946-af6e-4c6c-b9ed-66f4ed5195d1 tempest-ProjectMemberTests-1218408516 None] Create snapshot completed successfully
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-6ac9a63a-7e0b-489e-9258-af846d1e5383-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Lock "cinder-6ac9a63a-7e0b-489e-9258-af846d1e5383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-197964ac-381e-41ae-a4c6-339c69f9db37" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-197964ac-381e-41ae-a4c6-339c69f9db37" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-6ac9a63a-7e0b-489e-9258-af846d1e5383" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-6ac9a63a-7e0b-489e-9258-af846d1e5383" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Deleting offline snapshot 6ac9a63a-7e0b-489e-9258-af846d1e5383 of volume 197964ac-381e-41ae-a4c6-339c69f9db37 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] snapshot_file for this snap is: volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc04559a-64a0-44c5-97c9-40e1c4ae3bba]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:43 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:43 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383
Nov 05 04:36:43 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:44 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383" returned: 0 in 0.462s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:44 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-197964ac-381e-41ae-a4c6-339c69f9db37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:36:44 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe670f3b-4bbb-4118-bd90-99c7c0f2c113]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:44 devstack sudo[107822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37
Nov 05 04:36:44 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:44 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37" returned: 0 in 0.394s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:44 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:44 devstack sudo[107828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383
Nov 05 04:36:44 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:45 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383" returned: 0 in 0.375s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:45 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383
Nov 05 04:36:45 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:45 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37.6ac9a63a-7e0b-489e-9258-af846d1e5383" returned: 0 in 0.279s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-6ac9a63a-7e0b-489e-9258-af846d1e5383" released by "_delete_snapshot" :: held 1.625s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-197964ac-381e-41ae-a4c6-339c69f9db37" released by "delete_snapshot" :: held 1.652s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Flow 'volume_create_manager' (10196325-b172-4163-a235-a5a7bc4bc722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f7053f-faa2-4bfb-8b33-eb765d0e75ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f7053f-faa2-4bfb-8b33-eb765d0e75ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-816204260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b94c150-d636-400f-adee-612de34abd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385d1202202d4f5ea4efc39f5ce14b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:45Z,use_quota=True,user_id='b0693a31693e41e4961c3eb6712d1de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec64d2c-13c8-4146-93cb-35068513f367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec64d2c-13c8-4146-93cb-35068513f367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff74e7d-53d6-41ad-ae3d-a3e41ab6da70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff74e7d-53d6-41ad-ae3d-a3e41ab6da70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b94c150-d636-400f-adee-612de34abd70', 'volume_name': 'volume-7b94c150-d636-400f-adee-612de34abd70', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415833a4-19b3-4765-bda9-f824381bb0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415833a4-19b3-4765-bda9-f824381bb0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347a9fd1-2fe7-4e0a-9c92-b3cc02b42e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:45 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Volume 7b94c150-d636-400f-adee-612de34abd70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b94c150-d636-400f-adee-612de34abd70', 'volume_size': 1}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-816204260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b94c150-d636-400f-adee-612de34abd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385d1202202d4f5ea4efc39f5ce14b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:45Z,use_quota=True,user_id='b0693a31693e41e4961c3eb6712d1de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Creating volume 7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:45 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:45 devstack sudo[107836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 1073741824
Nov 05 04:36:45 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Created reservations ['860fd42e-c0da-4db3-a8f9-3f24efb15f7e', '23c03758-9a66-412c-ba45-c0db1d97cffb', 'cb3d99c0-000e-4acb-ae61-7485f0f0e951', '019f2e69-dc88-4aeb-a6d0-a09680ad1b90'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:45 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Delete snapshot completed successfully.
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ba43d015-3905-4638-bdd9-6b048b9e81fd tempest-ProjectMemberTests-1218408516 None] Lock "cinder-6ac9a63a-7e0b-489e-9258-af846d1e5383-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-197964ac-381e-41ae-a4c6-339c69f9db37-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-197964ac-381e-41ae-a4c6-339c69f9db37-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-197964ac-381e-41ae-a4c6-339c69f9db37" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-197964ac-381e-41ae-a4c6-339c69f9db37" acquired by "delete_volume" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ab358-be90-4be8-8466-26f9c3eb0d3f]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:45 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:46 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 1073741824" returned: 0 in 0.509s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:46 devstack sudo[107843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70
Nov 05 04:36:46 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:46 devstack sudo[107842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37
Nov 05 04:36:46 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:46 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70" returned: 0 in 0.276s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347a9fd1-2fe7-4e0a-9c92-b3cc02b42e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b94c150-d636-400f-adee-612de34abd70', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3458470-6e42-4ee8-b8c4-f7b7a4ac5630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:46 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Volume volume-7b94c150-d636-400f-adee-612de34abd70 (7b94c150-d636-400f-adee-612de34abd70): created successfully
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3458470-6e42-4ee8-b8c4-f7b7a4ac5630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:46 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Flow 'volume_create_manager' (10196325-b172-4163-a235-a5a7bc4bc722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37" returned: 0 in 0.375s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-5aa0321a-cd4c-41da-85b7-6af2a86ef159 tempest-SnapshotDependencyTests-648456162 None] Created volume successfully.
Nov 05 04:36:46 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37
Nov 05 04:36:46 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:46 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-197964ac-381e-41ae-a4c6-339c69f9db37" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-197964ac-381e-41ae-a4c6-339c69f9db37" released by "delete_volume" :: held 0.680s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Created reservations ['e58ae273-3922-4179-8014-4ae1a449d503', '136a39fc-0df4-485e-a17f-47658f4b0172', '18dc35be-c30c-4584-9a10-365b01b7a3b8', '3abe45aa-fb15-40dd-a6a4-e8d5d4676b30'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:46 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:46 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:46 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.250s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:46 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:46 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Deleted volume successfully.
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-ef4478a5-a19c-45f0-9efe-a0dae05cbf84 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-197964ac-381e-41ae-a4c6-339c69f9db37-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (e469854d-a841-4d56-9b8b-8f4afedeb825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb2a72f-dd99-42a6-a74a-df6dd20c4169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb2a72f-dd99-42a6-a74a-df6dd20c4169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543401974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd0cab4-3b04-457c-a145-fe31f987399d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:47Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f200b2-d83f-4b19-be0e-cfb284d7431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2f200b2-d83f-4b19-be0e-cfb284d7431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dd47a4-a8cd-448d-b596-3e0ddf27b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dd47a4-a8cd-448d-b596-3e0ddf27b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dd0cab4-3b04-457c-a145-fe31f987399d', 'volume_name': 'volume-9dd0cab4-3b04-457c-a145-fe31f987399d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7f8f64-df7f-46fc-b6fc-ea140faa4fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7f8f64-df7f-46fc-b6fc-ea140faa4fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8aae54-c214-4629-acc7-4da27daa369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:47 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Volume 9dd0cab4-3b04-457c-a145-fe31f987399d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dd0cab4-3b04-457c-a145-fe31f987399d', 'volume_size': 1}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1543401974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dd0cab4-3b04-457c-a145-fe31f987399d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:47Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Creating volume 9dd0cab4-3b04-457c-a145-fe31f987399d {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:47 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:47 devstack sudo[107856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d 1073741824
Nov 05 04:36:47 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:47 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d 1073741824" returned: 0 in 0.412s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:47 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:48 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d
Nov 05 04:36:48 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:48 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d" returned: 0 in 0.235s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.532s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Creating offline snapshot cabb606a-1362-471d-99f3-fcecdbad2501 of volume 7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8aae54-c214-4629-acc7-4da27daa369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dd0cab4-3b04-457c-a145-fe31f987399d', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0383989-93d0-42b0-a032-55692dabfc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[903b2147-3fa5-487a-afa2-68ead6b765c3]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:48 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Volume volume-9dd0cab4-3b04-457c-a145-fe31f987399d (9dd0cab4-3b04-457c-a145-fe31f987399d): created successfully
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0383989-93d0-42b0-a032-55692dabfc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (e469854d-a841-4d56-9b8b-8f4afedeb825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:48 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-2cfcb9c4-97e3-407c-9290-1306642b6479 tempest-ProjectMemberTests-1218408516 None] Created volume successfully.
Nov 05 04:36:48 devstack sudo[107864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70
Nov 05 04:36:48 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:48 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:48 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:48 devstack sudo[107869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 1G
Nov 05 04:36:48 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:49 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 1G" returned: 0 in 0.385s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b94c150-d636-400f-adee-612de34abd70 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:49 devstack sudo[107874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b94c150-d636-400f-adee-612de34abd70 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501
Nov 05 04:36:49 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:49 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b94c150-d636-400f-adee-612de34abd70 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501" returned: 0 in 0.289s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:49 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 is being set with open permissions: ugo+rw
Nov 05 04:36:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:49 devstack sudo[107879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501
Nov 05 04:36:49 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:49 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501" returned: 0 in 0.238s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:49 devstack sudo[107882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.info
Nov 05 04:36:49 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:49 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.info" returned: 0 in 0.253s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:49 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.info is being set with open permissions: ugo+rw
Nov 05 04:36:49 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:49 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.info
Nov 05 04:36:49 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:50 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.info" returned: 0 in 0.247s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.501s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Creating offline snapshot e978e98d-a38a-431b-8e07-17f608c6262c of volume 9dd0cab4-3b04-457c-a145-fe31f987399d {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:36:50 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-420d2b2e-e2a0-404a-a5ee-a64e728da42a tempest-SnapshotDependencyTests-648456162 None] Create snapshot completed successfully
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[845d005a-7ae9-4a02-9996-1dae31c62c9b]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:50 devstack sudo[107889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d
Nov 05 04:36:50 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:50 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d" returned: 0 in 0.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:50 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c 1G
Nov 05 04:36:50 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:50 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c 1G" returned: 0 in 0.410s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:50 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dd0cab4-3b04-457c-a145-fe31f987399d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:50 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dd0cab4-3b04-457c-a145-fe31f987399d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c
Nov 05 04:36:50 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:51 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dd0cab4-3b04-457c-a145-fe31f987399d -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c" returned: 0 in 0.311s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:51 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c is being set with open permissions: ugo+rw
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:51 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c
Nov 05 04:36:51 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Flow 'volume_create_manager' (fb837df1-fbd1-4621-a209-ad5b65af4e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e0372f-73c6-4d4b-a2ab-c0c401f17791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e0372f-73c6-4d4b-a2ab-c0c401f17791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61008922-e0ad-49c4-aee8-d0427107b4ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='385d1202202d4f5ea4efc39f5ce14b5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cabb606a-1362-471d-99f3-fcecdbad2501,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:51Z,use_quota=True,user_id='b0693a31693e41e4961c3eb6712d1de7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f10f46-49f2-42f8-a312-afae6ff177b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f10f46-49f2-42f8-a312-afae6ff177b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25424f9-683e-4e14-b70b-e2eb843653df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b25424f9-683e-4e14-b70b-e2eb843653df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '61008922-e0ad-49c4-aee8-d0427107b4ce', 'volume_name': 'volume-61008922-e0ad-49c4-aee8-d0427107b4ce', 'volume_size': 1, 'snapshot_id': 'cabb606a-1362-471d-99f3-fcecdbad2501'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d4b2f7-10c6-4773-97e8-a805f1b1eec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d4b2f7-10c6-4773-97e8-a805f1b1eec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf963670-c7c7-4ac0-a2e1-9bffeb2b7d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:51 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Volume 61008922-e0ad-49c4-aee8-d0427107b4ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-61008922-e0ad-49c4-aee8-d0427107b4ce', 'volume_size': 1, 'snapshot_id': 'cabb606a-1362-471d-99f3-fcecdbad2501'}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:51 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c" returned: 0 in 0.252s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:51 devstack sudo[107908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.info
Nov 05 04:36:51 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:51 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.info" returned: 0 in 0.252s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:51 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.info is being set with open permissions: ugo+rw
Nov 05 04:36:51 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:51 devstack sudo[107911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.info
Nov 05 04:36:51 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:52 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.info" returned: 0 in 0.240s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.550s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "cinder-quobyte-cabb606a-1362-471d-99f3-fcecdbad2501-61008922-e0ad-49c4-aee8-d0427107b4ce" by "_create_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-cabb606a-1362-471d-99f3-fcecdbad2501-61008922-e0ad-49c4-aee8-d0427107b4ce" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Creating volume 61008922-e0ad-49c4-aee8-d0427107b4ce from snapshot cabb606a-1362-471d-99f3-fcecdbad2501 {{(pid=87166) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "cinder-quobyte-61008922-e0ad-49c4-aee8-d0427107b4ce" by "_copy_volume_from_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-61008922-e0ad-49c4-aee8-d0427107b4ce" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] snapshot: cabb606a-1362-471d-99f3-fcecdbad2501, volume: 61008922-e0ad-49c4-aee8-d0427107b4ce,  {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 05 04:36:52 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-0a2d869c-d62d-46da-9f04-f1dcce698fc4 tempest-ProjectMemberTests-1218408516 None] Create snapshot completed successfully
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9237dc26-a75f-4e42-95aa-c5bfe649ecb5]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:52 devstack sudo[107914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501
Nov 05 04:36:52 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:52 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501" returned: 0 in 0.348s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b94c150-d636-400f-adee-612de34abd70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea0f76-e4a4-49b5-8277-481972dfa866]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:52 devstack sudo[107919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70
Nov 05 04:36:52 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-e978e98d-a38a-431b-8e07-17f608c6262c-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-e978e98d-a38a-431b-8e07-17f608c6262c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-9dd0cab4-3b04-457c-a145-fe31f987399d" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:52 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70" returned: 0 in 0.373s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Creating direct copy from snapshot {{(pid=87166) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.utils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Path /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce not found in is_blk_device check {{(pid=87166) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-9dd0cab4-3b04-457c-a145-fe31f987399d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-e978e98d-a38a-431b-8e07-17f608c6262c" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:52 devstack sudo[107924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce
Nov 05 04:36:52 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-e978e98d-a38a-431b-8e07-17f608c6262c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Deleting offline snapshot e978e98d-a38a-431b-8e07-17f608c6262c of volume 9dd0cab4-3b04-457c-a145-fe31f987399d {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] snapshot_file for this snap is: volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b348c6b-b880-4be8-bc87-d30dba6aedff]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:52 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:53 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c
Nov 05 04:36:53 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:53 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c" returned: 0 in 0.371s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:53 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dd0cab4-3b04-457c-a145-fe31f987399d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:36:53 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3badf5a0-46a7-4d74-9b0c-e28196947c8d]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:53 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d
Nov 05 04:36:53 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:53 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d" returned: 0 in 0.525s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:53 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:53 devstack sudo[107946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c
Nov 05 04:36:53 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:54 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c" returned: 0 in 0.535s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:54 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c
Nov 05 04:36:54 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:54 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:54 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d.e978e98d-a38a-431b-8e07-17f608c6262c" returned: 0 in 0.321s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-e978e98d-a38a-431b-8e07-17f608c6262c" released by "_delete_snapshot" :: held 1.964s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:54 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-9dd0cab4-3b04-457c-a145-fe31f987399d" released by "delete_snapshot" :: held 1.988s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:54 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Created reservations ['76c19c49-044b-4111-a64f-b1db5dd29d5b', '7f113a5b-7820-4bc9-8d01-a51063f9fe77', 'a8017d48-a6ba-4e1c-99a5-7d777d449fce', 'c00718ba-8928-41f4-9adb-0311c25f04bd'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:55 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Delete snapshot completed successfully.
Nov 05 04:36:55 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-98101bee-0f5e-4803-abb8-f58dcac54a00 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-e978e98d-a38a-431b-8e07-17f608c6262c-delete_snapshot" released by "delete_snapshot" :: held 2.236s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-9dd0cab4-3b04-457c-a145-fe31f987399d-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-9dd0cab4-3b04-457c-a145-fe31f987399d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-9dd0cab4-3b04-457c-a145-fe31f987399d" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:36:56 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-9dd0cab4-3b04-457c-a145-fe31f987399d" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:36:56 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b86fd4-3f26-41fc-8e50-607ce05c417e]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:56 devstack sudo[107955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d
Nov 05 04:36:56 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:56 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d" returned: 0 in 0.587s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:56 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:56 devstack sudo[107960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d
Nov 05 04:36:56 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:57 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dd0cab4-3b04-457c-a145-fe31f987399d" returned: 0 in 0.306s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:57 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-9dd0cab4-3b04-457c-a145-fe31f987399d" released by "delete_volume" :: held 1.024s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:57 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Created reservations ['8e006459-77f5-4413-9e0d-a0110eed3067', '3f165e23-d7e8-4e1e-b302-9097f597f4de', 'ec956299-4e25-4b9b-baae-41ea83f7fd30', 'ede2e0a2-c4fa-4c09-a155-96068efc1081'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:36:57 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:57 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:57 devstack sudo[107963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:36:57 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:58 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:58 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.494s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:58 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:36:58 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Deleted volume successfully.
Nov 05 04:36:58 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-077812fb-eabc-4ea1-9d72-0cd480f40d03 tempest-ProjectMemberTests-1218408516 None] Lock "cinder-9dd0cab4-3b04-457c-a145-fe31f987399d-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87166) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (4dbebade-0295-4c33-ab5d-d265601648c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa89e40-2b71-49d5-86c8-00b90d29c0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa89e40-2b71-49d5-86c8-00b90d29c0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461222562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfb9a72-b8c6-488b-8b94-6afeddc4b134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:59Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20aa514-dcda-4899-a3ca-39a09e9f9ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20aa514-dcda-4899-a3ca-39a09e9f9ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85134cbd-325d-494c-b382-1d194dbe4cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85134cbd-325d-494c-b382-1d194dbe4cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfb9a72-b8c6-488b-8b94-6afeddc4b134', 'volume_name': 'volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c06e67-6057-4a04-a492-051b6afd7ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c06e67-6057-4a04-a492-051b6afd7ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b2b66a-0e9b-40b6-9d61-cfa961ceca11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:36:59 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Volume 9dfb9a72-b8c6-488b-8b94-6afeddc4b134: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134', 'volume_size': 1}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:59 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce" returned: 0 in 6.813s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.image.image_utils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Image conversion details: src /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce {{(pid=87166) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 05 04:36:59 devstack cinder-volume[87166]: INFO cinder.image.image_utils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Converted 1024.00 MB image at 150.27 MB/s
Nov 05 04:36:59 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce is being set with open permissions: ugo+rw
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:36:59 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce
Nov 05 04:36:59 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:36:59 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce" returned: 0 in 0.239s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-61008922-e0ad-49c4-aee8-d0427107b4ce" released by "_copy_volume_from_snapshot" :: held 7.857s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-cabb606a-1362-471d-99f3-fcecdbad2501-61008922-e0ad-49c4-aee8-d0427107b4ce" released by "_create_volume_from_snapshot" :: held 7.923s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.945s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f05f2a87350>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-05T03:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-461222562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfb9a72-b8c6-488b-8b94-6afeddc4b134,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c2b95a8681468ca541bd430cc9846e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T03:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T03:36:59Z,use_quota=True,user_id='f167a5face0845209ed9ce436373ce93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d098283-7f5f-4600-a7b1-a832b0861274),volume_type_id=5d098283-7f5f-4600-a7b1-a832b0861274)}" {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Creating volume 9dfb9a72-b8c6-488b-8b94-6afeddc4b134 {{(pid=87166) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:36:59 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Selected osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574 as target Quobyte volume. {{(pid=87166) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 05 04:37:00 devstack cinder-volume[87166]: INFO cinder.volume.drivers.remotefs [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] casted to osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 1073741824 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:00 devstack sudo[107970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 1073741824
Nov 05 04:37:00 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf963670-c7c7-4ac0-a2e1-9bffeb2b7d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61008922-e0ad-49c4-aee8-d0427107b4ce', 'volume_size': 1, 'snapshot_id': 'cabb606a-1362-471d-99f3-fcecdbad2501'}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859a83d2-887f-4cf8-9f01-6ab29ff89b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:37:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Volume volume-61008922-e0ad-49c4-aee8-d0427107b4ce (61008922-e0ad-49c4-aee8-d0427107b4ce): created successfully
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859a83d2-887f-4cf8-9f01-6ab29ff89b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Flow 'volume_create_manager' (fb837df1-fbd1-4621-a209-ad5b65af4e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:37:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-cc7f86bf-42cf-4698-bde5-6068f7b01772 tempest-SnapshotDependencyTests-648456162 None] Created volume successfully.
Nov 05 04:37:00 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 1073741824" returned: 0 in 0.411s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:00 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134
Nov 05 04:37:00 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:00 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" returned: 0 in 0.241s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'} {{(pid=87166) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3b2b66a-0e9b-40b6-9d61-cfa961ceca11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134', 'volume_size': 1}' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61ddc1c-2376-4f40-aac2-fb1a3a39c193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 05 04:37:00 devstack cinder-volume[87166]: INFO cinder.volume.flows.manager.create_volume [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Volume volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 (9dfb9a72-b8c6-488b-8b94-6afeddc4b134): created successfully
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61ddc1c-2376-4f40-aac2-fb1a3a39c193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87166) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 05 04:37:00 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Flow 'volume_create_manager' (4dbebade-0295-4c33-ab5d-d265601648c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87166) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 05 04:37:00 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-dc867b1e-54a2-4ce3-b045-3eb9e12dbc49 tempest-ProjectMemberTests-1218408516 None] Created volume successfully.
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "cinder-cabb606a-1362-471d-99f3-fcecdbad2501-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-cabb606a-1362-471d-99f3-fcecdbad2501-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "cinder-quobyte-7b94c150-d636-400f-adee-612de34abd70" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-7b94c150-d636-400f-adee-612de34abd70" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "cinder-quobyte-cabb606a-1362-471d-99f3-fcecdbad2501" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-cabb606a-1362-471d-99f3-fcecdbad2501" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Deleting offline snapshot cabb606a-1362-471d-99f3-fcecdbad2501 of volume 7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] snapshot_file for this snap is: volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30e5950-9348-4ff6-b868-eab50a447da2]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:37:01 devstack sudo[107978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501
Nov 05 04:37:01 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Creating offline snapshot 6e819982-4751-4a1e-b6bc-5596c727c80a of volume 9dfb9a72-b8c6-488b-8b94-6afeddc4b134 {{(pid=87166) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e95cbf4-9999-4f44-8ecb-c5e3be089794]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:01 devstack sudo[107980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134
Nov 05 04:37:01 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:01 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501" returned: 0 in 0.394s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b94c150-d636-400f-adee-612de34abd70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a566636-f52b-4f9a-97eb-e496fedbc82a]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:01 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" returned: 0 in 0.359s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:01 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a 1G {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:01 devstack sudo[107985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70
Nov 05 04:37:01 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:01 devstack sudo[107990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a 1G
Nov 05 04:37:01 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:02 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a 1G" returned: 0 in 0.388s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:02 devstack sudo[107998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a
Nov 05 04:37:02 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:02 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70" returned: 0 in 0.551s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:02 devstack sudo[108000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501
Nov 05 04:37:02 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:02 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 -F qcow2 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a" returned: 0 in 0.291s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:02 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a is being set with open permissions: ugo+rw
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:02 devstack sudo[108007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a
Nov 05 04:37:02 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:02 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501" returned: 0 in 0.330s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:02 devstack sudo[108011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501
Nov 05 04:37:02 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:02 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:02 devstack sudo[108014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.info
Nov 05 04:37:02 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:02 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70.cabb606a-1362-471d-99f3-fcecdbad2501" returned: 0 in 0.246s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-cabb606a-1362-471d-99f3-fcecdbad2501" released by "_delete_snapshot" :: held 1.644s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-7b94c150-d636-400f-adee-612de34abd70" released by "delete_snapshot" :: held 1.670s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:02 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Created reservations ['8119bcba-72f4-4df3-b3dd-13592745b9d9', 'e38c4408-2581-4e17-90cb-70a11db92f06', '18f7d205-da52-4e94-81cb-51a3de001ec4', '5d099bf8-4143-4b1b-9685-36a0c48eb9ba'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:37:02 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Delete snapshot completed successfully.
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-c54954fa-3488-48e1-9488-41e9851a58d0 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-cabb606a-1362-471d-99f3-fcecdbad2501-delete_snapshot" released by "delete_snapshot" :: held 1.807s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:03 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.info" returned: 0 in 0.268s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:03 devstack cinder-volume[87166]: WARNING cinder.volume.drivers.remotefs [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.info is being set with open permissions: ugo+rw
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.info {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:03 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.info
Nov 05 04:37:03 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:03 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.info" returned: 0 in 0.255s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.902s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:37:03 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-e29b94b5-a4bc-458c-80b1-748395efe7bc tempest-ProjectMemberTests-1218408516 None] Create snapshot completed successfully
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "cinder-7b94c150-d636-400f-adee-612de34abd70-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-7b94c150-d636-400f-adee-612de34abd70-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "cinder-quobyte-7b94c150-d636-400f-adee-612de34abd70" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-7b94c150-d636-400f-adee-612de34abd70" acquired by "delete_volume" :: waited 0.013s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ab4f21-6367-45d8-a214-3e6da3341e73]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:03 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70
Nov 05 04:37:03 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-6e819982-4751-4a1e-b6bc-5596c727c80a-delete_snapshot" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Lock "cinder-6e819982-4751-4a1e-b6bc-5596c727c80a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" by "delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-6e819982-4751-4a1e-b6bc-5596c727c80a" by "_delete_snapshot" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-6e819982-4751-4a1e-b6bc-5596c727c80a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Deleting offline snapshot 6e819982-4751-4a1e-b6bc-5596c727c80a of volume 9dfb9a72-b8c6-488b-8b94-6afeddc4b134 {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] snapshot_file for this snap is: volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a {{(pid=87166) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[2351ed55-9433-4931-92dd-b699cd8ca1aa]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:03 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70" returned: 0 in 0.384s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:03 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:03 devstack sudo[108023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a
Nov 05 04:37:03 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:03 devstack sudo[108028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70
Nov 05 04:37:03 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:04 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a" returned: 0 in 0.360s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:04 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.remotefs [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87166) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-7b94c150-d636-400f-adee-612de34abd70" returned: 0 in 0.270s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[628e1f43-1ee5-4656-a38f-5b2136287640]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-7b94c150-d636-400f-adee-612de34abd70" released by "delete_volume" :: held 0.735s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Created reservations ['a282b1fd-c87c-418e-bcb2-968a5807fd3f', 'da086398-fbc8-4a24-bff8-00637ab3d368', '354abada-bca5-44c9-88b5-961afc3809e9', '6d3e1cf2-b4d4-4ec0-b42f-6cede781aa77'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:37:04 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134
Nov 05 04:37:04 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:04 devstack sudo[108036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:37:04 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:04 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:04 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" returned: 0 in 0.386s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "cinder-61008922-e0ad-49c4-aee8-d0427107b4ce-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:04 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Deleted volume successfully.
Nov 05 04:37:04 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a
Nov 05 04:37:04 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-61008922-e0ad-49c4-aee8-d0427107b4ce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-23662008-8121-4e5e-a87c-2f115d744703 tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-7b94c150-d636-400f-adee-612de34abd70-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "cinder-quobyte-61008922-e0ad-49c4-aee8-d0427107b4ce" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-61008922-e0ad-49c4-aee8-d0427107b4ce" acquired by "delete_volume" :: waited 0.014s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a5d367-81e8-4208-aae2-8aaac43599f4]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:04 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce
Nov 05 04:37:04 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:04 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a" returned: 0 in 0.369s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:04 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:04 devstack sudo[108049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a
Nov 05 04:37:04 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:05 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce" returned: 0 in 0.365s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:05 devstack sudo[108054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce
Nov 05 04:37:05 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:05 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134.6e819982-4751-4a1e-b6bc-5596c727c80a" returned: 0 in 0.261s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-6e819982-4751-4a1e-b6bc-5596c727c80a" released by "_delete_snapshot" :: held 1.482s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" released by "delete_snapshot" :: held 1.509s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Created reservations ['596004db-fb23-40c2-bcd3-1d866b02cc00', '8a0931d7-f9a0-4b49-9aa2-e87b5d772bac', '831b7236-6578-44f4-a66d-8bd0f2ae851d', '9bbaf796-8781-4b08-bcf8-801f8ffecf2e'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:37:05 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-61008922-e0ad-49c4-aee8-d0427107b4ce" returned: 0 in 0.259s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-quobyte-61008922-e0ad-49c4-aee8-d0427107b4ce" released by "delete_volume" :: held 0.674s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Delete snapshot completed successfully.
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-49e4ff3d-ca4f-49c6-a208-a65a23cc403d tempest-ProjectMemberTests-1218408516 None] Lock "cinder-6e819982-4751-4a1e-b6bc-5596c727c80a-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Created reservations ['c5292e5a-3cde-472b-9b49-64389df22ce8', '26c9e828-8a77-430d-a146-dd4eb9f289f6', '5787bbe8-9aea-42ae-bd70-4974a40376bf', 'a9c08133-5cdc-4be2-b8b6-366aac7a4c47'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:05 devstack sudo[108058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:37:05 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:05 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.242s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:37:05 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Deleted volume successfully.
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-087b0ce2-778f-47ed-ae19-90eaf376f63f tempest-SnapshotDependencyTests-648456162 None] Lock "cinder-61008922-e0ad-49c4-aee8-d0427107b4ce-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-9dfb9a72-b8c6-488b-8b94-6afeddc4b134-delete_volume" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Lock "cinder-9dfb9a72-b8c6-488b-8b94-6afeddc4b134-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Acquiring lock "cinder-quobyte-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" by "delete_volume" {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" acquired by "delete_volume" :: waited 0.012s {{(pid=87166) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12fa8d-4b9d-4f62-8ed0-ef0cb3f097f7]: (4, 'qcow2') {{(pid=88717) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 05 04:37:05 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:06 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134
Nov 05 04:37:06 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:06 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" returned: 0 in 0.363s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134 {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:06 devstack sudo[108066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134
Nov 05 04:37:06 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:06 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b/volume-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Lock "cinder-quobyte-9dfb9a72-b8c6-488b-8b94-6afeddc4b134" released by "delete_volume" :: held 0.686s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG cinder.quota [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Created reservations ['38534752-e07c-43e7-955b-221c0dfb6d8e', 'f2c80ef9-74f0-401a-9f25-c446d591ddd5', '1d9b8497-5d67-4c88-96d9-5b9c6c057bc5', '500eaaa9-2ba2-4c7e-a703-95f2101e5ad4'] {{(pid=87166) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:06 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:37:06 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:06 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.258s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:06 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:37:06 devstack cinder-volume[87166]: INFO cinder.volume.manager [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Deleted volume successfully.
Nov 05 04:37:07 devstack cinder-volume[87166]: DEBUG cinder.coordination [None req-152240de-1f56-4dcc-9356-bebd9e1d270e tempest-ProjectMemberTests-1218408516 None] Lock "cinder-9dfb9a72-b8c6-488b-8b94-6afeddc4b134-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87166) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 05 04:37:16 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:INSERT=26,cinder:UPDATE=90,cinder:SELECT=66,cinder:DELETE=6 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:37:16 devstack cinder-volume[87166]: DEBUG dbcounter [-] [87166] Writing DB stats cinder:SELECT=74,cinder:INSERT=23,cinder:UPDATE=91,cinder:DELETE=9 {{(pid=87166) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574': None} {{(pid=87166) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG cinder.volume.drivers.quobyte [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-31388c5e-e714-45b6-806d-36cd0b150574'] {{(pid=87166) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.lockutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87166) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 05 04:37:29 devstack sudo[108200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b
Nov 05 04:37:29 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 05 04:37:29 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG oslo_concurrency.processutils [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e713fffee515b7b6c4f982601a5ae08b" returned: 0 in 0.251s {{(pid=87166) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG cinder.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Notifying Schedulers of capabilities ... {{(pid=87166) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG oslo_service.periodic_task [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] Running periodic task VolumeManager._thread_info {{(pid=87166) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread count: 28 {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 05 04:37:29 devstack cinder-volume[87166]: DEBUG cinder.volume.manager [None req-99a3714c-98bf-4472-87a0-c6521efcae99 None None] thread info: [<_MainThread(MainThread, started 139663636902016)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139663523641984)>, <Thread(Thread-3 (stat_writer), started daemon 139663521738688)>, <Thread(Rabbit-heartbeat, started daemon 139663520533184)>, <Thread(Thread-5 (_runner), started daemon 139663520636096)>, <Thread(Thread-7 (_runner), started daemon 139663520746432)>, <Thread(fd_logger, started daemon 139663518429824)>, <Thread(privsep_reader, started daemon 139663520310016)>, <Thread(tpool_thread_0, started daemon 139663511979712)>, <Thread(tpool_thread_1, started daemon 139663503587008)>, <Thread(tpool_thread_2, started daemon 139663495194304)>, <Thread(tpool_thread_3, started daemon 139663486801600)>, <Thread(tpool_thread_4, started daemon 139663478408896)>, <Thread(tpool_thread_5, started daemon 139663470016192)>, <Thread(tpool_thread_6, started daemon 139663461623488)>, <Thread(tpool_thread_7, started daemon 139663453230784)>, <Thread(tpool_thread_8, started daemon 139663444838080)>, <Thread(tpool_thread_9, started daemon 139663436445376)>, <Thread(tpool_thread_10, started daemon 139663428036288)>, <Thread(tpool_thread_11, started daemon 139663419627200)>, <Thread(tpool_thread_12, started daemon 139663411218112)>, <Thread(tpool_thread_13, started daemon 139663402809024)>, <Thread(tpool_thread_14, started daemon 139663394399936)>, <Thread(tpool_thread_15, started daemon 139663385990848)>, <Thread(tpool_thread_16, started daemon 139663377581760)>, <Thread(tpool_thread_17, started daemon 139663369172672)>, <Thread(tpool_thread_18, started daemon 139663360763584)>, <Thread(tpool_thread_19, started daemon 139663352354496)>] {{(pid=87166) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}